| Sr Data Engineer (Control-M to Astronomer managed Airflow)- Remote Role at Remote, Remote, USA |
| Email: [email protected] |
| From: Manish, epeopletech [email protected] Reply to: [email protected] Hi, We have an urgent opening with Sr Data Engineer (Control-M to Astronomer managed Airflow) and I have sent you job description, please go through it and let me know your comfort with it and also send me your updated resume ASAP. Position : Sr Data Engineer (Control-M to Astronomer managed Airflow) Location : Remote Role Duration : 3-4 Months contract Airflow Experienced Resource for Control-M to Airflow Migration, Azure 5 years. Need 7+ Years exp. Overview: We are seeking a talented and experienced individual to join our team as an Airflow Specialist with expertise in migrating jobs from Control-M to Astronomer managed Airflow. In this role, you will play a crucial part in transitioning our workload orchestration from Control-M to Airflow, ensuring seamless and efficient execution of data workflows. Responsibilities: Migration Planning: Collaborate with stakeholders to understand existing Control-M job dependencies, schedules, and requirements. Develop a comprehensive migration plan outlining the step-by-step process for transitioning jobs to Airflow. Airflow Implementation: Configure and set up Astronomer Airflow environments for optimal performance. Design and implement Airflow DAGs (Directed Acyclic Graphs) to represent and schedule workflows efficiently. Utilize Airflow operators and sensors to integrate with various systems and technologies. Job Migration: Analyze existing Control-M jobs and translate their logic into Airflow workflows. Ensure data integrity and consistency during the migration process. Debug and troubleshoot issues that may arise during the migration. Documentation: Create comprehensive documentation for migrated workflows, including DAG structures, dependencies, and scheduling details. Provide training and knowledge transfer sessions to the operations team for managing and maintaining Airflow workflows. Optimization and Performance Tuning: Fine-tune Airflow configurations for optimal performance and resource utilization. Identify and implement improvements to enhance overall system efficiency. Collaboration: Work closely with cross-functional teams, including data engineers, developers, and system administrators, to ensure a smooth transition and ongoing support. Qualifications: Proven experience in Astronomer Airflow implementation and management. Strong understanding of workflow orchestration and job scheduling concepts. Prior experience in migrating jobs from Control-M or similar scheduling tools to Airflow. Proficiency in Python scripting for Airflow DAG development. Knowledge of database systems, cloud services, and other technologies commonly integrated with Airflow. Excellent problem-solving and debugging skills. Strong communication skills and the ability to collaborate effectively with diverse teams. Education and Experience: Bachelors degree in computer science, Information Technology, or a related field. Minimum of 3 years of hands-on experience with Airflow. Previous experience with Control-M or similar job scheduling tools is a plus. If you are a motivated and skilled professional with a passion for orchestrating data workflows using Airflow, we invite you to apply and contribute to the success of our migration project. Join us in embracing cutting-edge technologies and optimizing our data processing capabilities. Thanks & Regards Manish Sharma ePeople Technologies Inc 255 Baldwin Road, Suite 205, Parsippany, NJ 07054 Email:[email protected] Linkedin: linkedin.com/in/manish-sharma-46aa1a21a http://www.epeopletech.com P Go Green! Please do not print this e-mail unless necessary Note: ePeople Technologies Inc is an Equal Employment Opportunity employer. All qualified applicants will receive consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence, and performance of the essential functions of their positions. We promote and support a diverse workforce at all levels in the company. This is not an unsolicited mail and if it is not intended for you or you are not interested in receiving our e-mails please forward this email to with "remove" in the subject line and mention all the e-mail addresses to be removed with any e-mail addresses, which might be diverting the e-mails to you. We are extremely sorry if our email has caused any inconvenience to you. Keywords: information technology golang New Jersey |
| [email protected] View all |
| Wed Nov 29 18:33:00 UTC 2023 |