| Looking for : Azure DevOps, DataOps Architect : Remote EST at Remote, Remote, USA |
| Email: [email protected] |
| From: Prakash Singh, RCI [email protected] Reply to: [email protected] Title: Azure DevOps/DataOps Architect Location: 100% Remote, EST hours Duration: 4 months Visa: Any Look for an Architect level person. Should be mainly in to Azure Cloud Someone who had done DevOps in the Data Space. DevOps in the data area (Azure Data Factory, Databricks, etc.) Key Notes: DataOps is data engineering CI/CD automation, so we need candidates with DevOps experience with a data engineering background in 1 or 2 DE projects. At the same time, the candidate shouldn't be a Data architect or Data engineer. Consultant must have implemented using Azure stack of data engineering tools like ADF, ADB, ARM templates, and other Azure security and networking configuration. Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Looking for someone who has Implemented Azure Devops on at least 2 projects. DevOps in the data area (Azure Data Factory, Databricks, etc.). Good communication skills Experienced, hands-on DevOps Architect with experience establishing a DevOps for data platform and process for an Azure cloud Data warehouse and data pipeline platform. Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into data warehouses. Understanding of extract, load, transform (ELT) and extract, transform, load (ETL) tools. Using automation to streamline data processing to reduce development time and increase data reliability. Hands-on experience to automate manual processes, such as data extraction and testing. Hands-on experience managing the production of data pipelines. Communicate and collaborate with other data and BI team members to enhance the quality of data products. Hands-on experience with Design, Develop and Executing automated testing at every stage of a pipeline to increase productivity while reducing errors. This includes unit tests (testing separate components of a data pipeline) as well as performance tests (testing the responsiveness) and end-to-end tests (testing the whole pipeline). Hands-on experience with testing and adopting solutions and tools that adhere to the DataOps best practices. Hands-on experience handling security and ensure data security standards are applied across the data pipelines. Hands-on skills on IaC Automation to improve development and deployment processes. Implement DevOps for data process for the pilot scope including code repository folder structure and Branching Strategy Deploy DevOps for data pipelines, SQL Artifacts, and all components for the Pilot Scope Work with Infrastructure Engineer for IaC design and development of static and dynamic components including KMS, Secrets Roles, Policies, Clusters, Pipelines, DDL/DML, etc. Establish end to end CI/CD pipelines for all artifacts Migrate dev code to QA using the DevOps Framework Integration testing of DevOps for data framework in the QA environment Update DevOps for data Track documentation as necessary Keywords: continuous integration continuous deployment quality analyst business intelligence information technology Delaware |
| [email protected] View all |
| Wed Sep 27 02:25:00 UTC 2023 |