| Senior Python Data Engineer || Remote || AWS Certifications at Remote, Remote, USA |
| Email: [email protected] |
| From: Abhimanyu, Smart Source Technologies Inc [email protected] Reply to: [email protected] Sr Python Data Engineer Location : Remote Duration : Long Term Contract Visa : H1b, GC , USC Experience Required 12 + years of experience Required Qualifications: 12+ years of experience in data engineering, with a strong focus on AWS cloud services (SQS, S3, Lambda, Step Functions, EFS, OpenSearch). Proven experience in leading data engineering teams and delivering large-scale, production-grade data solutions. Expertise in API integrations and working with large-scale, real-time data pipelines. Hands-on experience with PySpark for distributed data processing and parallelism in large-scale ingestion pipelines. Advanced knowledge of AWS OpenSearch and its APIs for managing search indices. Extensive experience with Terraform for automating and managing cloud infrastructure. Strong understanding of data flow architectures, distributed systems, and document stores. Experience with AWS SageMaker for deploying machine learning models and managing endpoints. Proven track record of optimizing data pipelines for cost-efficiency, scalability, and performance. Familiarity with AWS monitoring tools like CloudWatch to track and enhance pipeline performance. Keywords: sthree green card Senior Python Data Engineer || Remote || AWS Certifications [email protected] |
| [email protected] View all |
| Thu Sep 19 20:26:00 UTC 2024 |