Lead Data Engineer with Databricks (PA, NJ, NY, VA, OH Candidates only) at Philadelphia, Pennsylvania, USA |
Email: [email protected] |
Hi, Position: Lead Data Engineer with Databricks Location: PHILADELPHIA, PA (Hybrid) Client: DXC Technology Overview: We are seeking a skilled and experienced Lead Data Engineer to join our team and play a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions. Key Responsibilities: Lead a team of data engineers in developing and maintaining scalable data pipelines for the platform. Optimize data capture, ingestion, and processing workflows to support advanced analytics, data science, and operational intelligence. Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployments, and implement data preparation workflows. Ensure data engineering processes are designed for high performance, scalability, and resource efficiency. Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation. Design and maintain data pipelines for streaming data, batch processing, and real-time analytics. Implement secure and scalable data capture and ingestion workflows. Support data preparation, exploration, and visualization to facilitate data-driven decision-making. Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements. Qualifications: Bachelors degree in computer science, a technical field, or a related business discipline; equivalent experience, certifications, or training will be considered. A masters degree is preferred. 5+ years of experience in designing and delivering secure cloud solutions. 3+ years of experience with Databricks. 2+ years of experience with Agile methodology. Strong problem-solving, analytical, and communication skills. -- Keywords: machine learning information technology Pennsylvania Lead Data Engineer with Databricks (PA, NJ, NY, VA, OH Candidates only) [email protected] |
[email protected] View all |
Wed Oct 23 00:01:00 UTC 2024 |