| Python Engineer with AIRFLOW OR ASTRONOMER at Remote, Remote, USA |
| Email: [email protected] |
| From: priyanka verma, Triwave Solutions Inc [email protected] Reply to: [email protected] Job Order Position Title : Python Engineer Assignment Period : 4/22/2024 to 4/22/2025 Job Order Location : Dallas, Texas Job Order Status : APPROVED AND RELEASED Job Order Type : Contract Job Order Rate Type: Hourly Job Order Owner : Admin Dexian Job Order Number of Positions : 1 Client : Dexian Position Responsibilities: *MUST HAVE AIRFLOW OR ASTRONOMER* Scope: Responsible for creating and maintaining data pipelines, data integrations and data products; technical pipeline development and improvement efforts. ESSENTIAL DUTIES AND RESPONSIBILITIES include the following. Other duties may be assigned. Design, build and maintain scalable data pipelines and data products Research, evaluate and POC new technologies and tools centered around cloud adoption and live/event-driven data streams Collaborate with other Data, BI and Test engineers to review design, code and test plan Work with Cloud Engineering, Enterprise Architecture and Information Security to ensure defined standards are being adhered to Cost management to optimize cloud storage and compute cost Develop a CI/CD framework from data pipelines Work across different teams to resolve operational and performance issues Creates technical documentation and data flow diagrams To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. QUALIFICATIONS Strong programming experience in Python Development experience with Airflow is required Experience in implementing data solutions in Microsoft Azure Cloud services including Blob Storage, Data Factory, AKS, Azure Cloud Database, Data Bricks Knowledge of Google Cloud Platform, Cloud Composer, Docker, Windows, SQL and Google Big Query Experience with cloud database technologies (RedShift, Big Query, Snowflake, etc.) Experience with reporting solutions, Microsoft Power BI preferred Thinks analytically and the ability to drive business decisions based on data and reporting Ability to interact effectively at varying levels of business and technical organization Excellent verbal, written and interpersonal skills Knowledge and understanding of incident management Advance problem solving and technical troubleshooting capabilities Strong organizational, multi-tasking and prioritizing skills Experience with developing real time data processing EDUCATION & EXPERIENCE REQUIREMENTS BS degree or higher in science or technology 2+ year of data engineering experience 2+ years of experience with Cloud platforms like GCP, Azure, and open source tools like Airflow 3+ years of data warehouse, relational database and SQL experience 3+ years of supporting ETL process and job scheduling experience 2+ years of Business Intelligence solution, reports and dashboards experience Azure certifications are recommended Keywords: continuous integration continuous deployment business intelligence Python Engineer with AIRFLOW OR ASTRONOMER [email protected] |
| [email protected] View all |
| Thu Mar 28 23:35:00 UTC 2024 |