Urgent Requirement for Azure DevOps/DataOps Architect || Remote|| EST TIME ZONE|| at Remote, Remote, USA |
Email: [email protected] |
Title: Azure DevOps/DataOps Architect 4 Months Location: 100% Remote Time Zone: EST Key Notes: Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Looking for someone who has Implemented Azure Devops on at least 2 projects. DevOps in the data area (Azure Data Factory, Databricks, etc.). Good communication skills Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into data warehouses. Understanding of extract, load, transform (ELT) and extract, transform, load (ETL) tools. Using automation to streamline data processing to reduce development time and increase data reliability. Hands-on experience to automate manual processes, such as data extraction and testing. Hands-on experience managing the production of data pipelines. Communicate and collaborate with other data and BI team members to enhance the quality of data products. Hands-on experience with Design, Develop and Executing automated testing at every stage of a pipeline to increase productivity while reducing errors. This includes unit tests (testing separate components of a data pipeline) as well as performance tests (testing the responsiveness) and end-to-end tests (testing the whole pipeline). Hands-on experience with testing and adopting solutions and tools that adhere to the DataOps best practices. Hands-on experience handling security and ensure data security standards are applied across the data pipelines. Hands-on skills on IaC Automation to improve development and deployment processes. Implement DevOps for data process for the pilot scope including code repository folder structure and Branching Strategy Deploy DevOps for data pipelines, SQL Artifacts, and all components for the Pilot Scope Work with Infrastructure Engineer for IaC design and development of static and dynamic components including KMS, Secrets Roles, Policies, Clusters, Pipelines, DDL/DML, etc. Establish end to end CI/CD pipelines for all artifacts Migrate dev code to QA using the DevOps Framework Integration testing of DevOps for data framework in the QA environment Update DevOps for data Track documentation as necessary -- Kind Regards, Sugam Saurav Email Id [email protected] Keywords: continuous integration continuous deployment quality analyst business intelligence information technology golang Idaho |
[email protected] View all |
Tue Aug 15 20:35:00 UTC 2023 |