Cloud Data Engineer Airflow admin :: Chicago IL (Onsite) :: Contract / FTE / Full-Time / Permanent at Chicago, Illinois, USA |
Email: [email protected] |
Job Title: Cloud Data Engineer Airflow admin Location: Chicago IL (Onsite) Position Type: Contract / FTE / Full-Time / Permanent Mandatory Skills: Snowflake and Airflow Primary skill: Snowflake and Airflow Secondary skill: Kubernetes Job Description Responsibilities: 1. Design, implement, and optimize end-to-end data pipelines in cloud and on-prem environments. 2. Utilize Kubernetes for efficient container orchestration and deployment of data applications. 3. Develop and maintain Python-based scripts and code for data processing and transformation. 4. Leverage Snowflake for managing and enhancing data warehousing capabilities. 5. Implement, manage, and troubleshoot data workflows using Apache Airflow. 6. Conduct thorough data analysis to extract valuable insights and support decision-making processes. 7. Utilize Azure services for cloud data solutions and integrations. Requirements: 1. Bachelor's degree in Computer Science, Data Engineering, or a related field. 2. Proven experience in cloud data engineering, demonstrating a strong understanding of data architecture and best practices. 3. Proficient in Python for data manipulation, scripting, and automation. 4. Hands-on experience with Kubernetes for containerized application deployment. 5. Expertise in Snowflake for effective data warehousing and analytics. 6. Expertise with Apache Airflow for workflow automation and orchestration. 7. Experience with Azure cloud services for data solutions and integrations. 8. Solid background in data analysis, utilizing tools and techniques to derive meaningful insights. 9. Strong problem-solving skills and the ability to troubleshoot complex data issues. 10. Effective communication skills to collaborate with cross-functional teams. 11. Proactive in staying abreast of industry trends and advancements in cloud data engineering. 12. Experience with traditional ETL tools like Datastage and scheduling tools like Control-M a plus. If you possess these qualifications and are eager to contribute to a dynamic team, please submit your resume outlining your relevant experience. Regards Rupesh Gupta Sr. Technical Recruiter Diverse Lynx LLC |300 Alexander Park|Suite #200|Princeton , NJ 08540 Office: +732-452-1006 Ext 433 Email: [email protected] | URL: http://www.diverselynx.com -- Keywords: information technology Illinois New Jersey Cloud Data Engineer Airflow admin :: Chicago IL (Onsite) :: Contract / FTE / Full-Time / Permanent [email protected] |
[email protected] View all |
Fri Aug 02 21:00:00 UTC 2024 |