| Immediate Hiring !! Data Engineer || Long Term Contract || St. Louis, MO [Onsite] at St Louis, Missouri, USA |
| Email: [email protected] |
| From: Midunsathyaa, Dimiour [email protected] Reply to: [email protected] Role Title: Data Engineer Location: St. Louis, MO [Onsite] Duration: Contract Mandatory Skills: Apache Spark, Airflow, Scala, Python, AWS, CI/CD. Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark and other ETL tools. Implement data processing workflows using Apache Airflow to ensure efficient data ingestion and transformation. Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets. Write efficient data transformation scripts in Scala and Python to process large datasets. Manage data storage solutions on AWS, including S3, Redshift, and other AWS services. Develop and implement CI/CD pipelines to automate data deployment and improve code quality. Monitor data pipelines and troubleshoot issues to ensure optimal performance and reliability. Document data architecture and workflows to maintain clear communication within the team. Keywords: continuous integration continuous deployment sthree Missouri Immediate Hiring !! Data Engineer || Long Term Contract || St. Louis, MO [Onsite] [email protected] |
| [email protected] View all |
| Thu Oct 10 21:09:00 UTC 2024 |