| Lead Data Engineer at Philadelphia, Pennsylvania, USA |
| Email: [email protected] |
| Hi, This is Priyanka, and I am Lead Recruiter with Net2Source Inc. if youre interested, please share your updated resume to [email protected] Job Title: Lead Data Engineer Location: Philadelphia PA (Day 1 onsite - Hybrid work schedule) Contract : 12+ Months Virtusa Job Description: Responsibilities: Minimum 10+ years experience with at least 2 years Leading the design of highly scalable and performant data platforms using modern data stack technologies such as Snowflake and Databricks on cloud platforms like AWS. Analyze business requirements to create data models and establish data ingestion, storage, and processing pipelines. Technology Evaluation: Continuously evaluate emerging data technologies, tools, and frameworks to identify opportunities for enhancement and innovation within the data platform. Make informed recommendations for adopting new technologies and practices that align with our business objectives. CI/CD Pipeline Deployment: Spearhead the implementation and deployment of efficient Continuous Integration and Continuous Deployment (CI/CD) pipelines for data platform components. Automate data workflows, testing, and deployment processes to ensure streamlined development and production releases. Containerization and Orchestration: Drive the adoption of containerization technologies such as Docker and orchestration platforms like Kubernetes for managing and scaling data infrastructure. Implement containerized data services to enhance resource utilization and portability. Performance Optimization: Collaborate with Data Engineers and Data Scientists to optimize data processing and analytics workloads. Identify bottlenecks and inefficiencies within the data platform and implement solutions to improve performance and reduce latency. Team Leadership and Mentorship: Lead a team of Data Engineers and Platform Engineers, providing technical guidance, mentorship, and coaching. Foster a culture of collaboration, continuous learning, and innovation within the team. Data Governance: Work closely with the Data Governance team to ensure adherence to data quality standards, data lineage, and data lifecycle management. Regards, Priyanka Lead Recruiter Net 2 Source Inc -- Keywords: continuous integration continuous deployment access management information technology Pennsylvania |
| [email protected] View all |
| Fri Jul 28 20:44:00 UTC 2023 |