| Job Description: Data Engineer at Plano, Texas, USA |
| Email: [email protected] |
| NEED LOCAL CANDIDATES ONLY Job Description: Data Engineer Location: Plano, TX (Hybrid - 3 days in office) Key Responsibilities: Data Engineering & Development: Design, develop, and maintain large-scale data pipelines using Databricks and AWS technologies. Optimize ETL processes and ensure data pipelines are scalable and reliable. Work with structured and unstructured data to ensure efficient data storage and processing. Collaboration & Stakeholder Management: Collaborate with data scientists, analysts, and business stakeholders to understand data requirements. Communicate technical solutions effectively to non-technical stakeholders. Provide technical expertise on best practices for cloud and data solutions. Data Governance & Security: Implement data governance policies to ensure compliance with regulatory and security requirements. Manage access control and data security across platforms. Performance Optimization: Monitor data pipelines and optimize them for performance and cost-efficiency. Troubleshoot and resolve data processing issues proactively. Documentation & Support: Maintain comprehensive documentation of data pipelines, architecture, and workflows. Provide ongoing support for data systems and processes in collaboration with IT teams Required Skills & Qualifications: Proficiency in Databricks: Hands-on experience building pipelines and working with data lakes. Strong AWS Skills: Knowledge of services like S3, Lambda, Glue, Redshift, and EC2. Experience with SQL and Python for data processing and analysis. Familiarity with CI/CD pipelines for data workflows. Strong problem-solving abilities and an eye for optimization. Excellent communication and teamwork skills. Preferred Skills: Exposure to Snowflake or other cloud data warehousing tools. Familiarity with Airflow or similar orchestration tools. Knowledge of data governance frameworks and security best practices. Best Regards, Mohammad Adnan Khan ApTask is a global, diversity certified staffing and recruiting company that specializes in IT, finance and accounting, and blockchain developer placements. Connect: 315 828 0022/ 551 239 8613 | [email protected] | linkedin.com/in/mohammad-adnan-khan-18545418b Address: 120 Wood Ave South, Iselin, NJ 08830 -- Keywords: continuous integration continuous deployment sthree information technology New Jersey Texas Job Description: Data Engineer [email protected] |
| [email protected] View all |
| Wed Oct 23 22:34:00 UTC 2024 |