| Lead Python Data Engineer at Remote, Remote, USA |
| Email: [email protected] |
| From: Salil, Smart Source Technologies [email protected] Reply to: [email protected] Python Data Engineer Location : Fully Remote Duration : Long Term Contract Pay : Open on C2C Note 1 : For H1b, GC , GC EAD must share passport number Note 2 : Need AWS Certifications Note 3 : Need 12 - 15 + years of experience Need who can interview tomorrow Note from client - NO JNTU/ GITAM/ OSMANIA candidates Required Qualifications: 10+ years of experience in data engineering, with a strong focus on AWS cloud services (SQS, S3, Lambda, Step Functions, EFS, OpenSearch). Proven experience in leading data engineering teams and delivering large-scale, production-grade data solutions. Expertise in API integrations and working with large-scale, real-time data pipelines. Hands-on experience with PySpark for distributed data processing and parallelism in large-scale ingestion pipelines. Advanced knowledge of AWS OpenSearch and its APIs for managing search indices. Extensive experience with Terraform for automating and managing cloud infrastructure. Strong understanding of data flow architectures, distributed systems, and document stores. Experience with AWS SageMaker for deploying machine learning models and managing endpoints. Proven track record of optimizing data pipelines for cost-efficiency, scalability, and performance. Familiarity with AWS monitoring tools like CloudWatch to track and enhance pipeline performance. Keywords: sthree green card Lead Python Data Engineer [email protected] |
| [email protected] View all |
| Wed Sep 25 19:06:00 UTC 2024 |