| Azure Infrastructure DEVOPS Engineer (Data Engineering Specialist) || Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Mounika, Anveta Inc [email protected] Reply to: [email protected] Role: Azure Infrastructure DEVOPS Engineer (Data Engineering Specialist) Location: REMOTE (Occasionally needs to go onsite Nashville, TN) Duration: 6+ Months As an Azure Infrastructure DevOps Engineer - Data Engineering Specialist, you will play a pivotal role in designing, implementing, and managing the deployment pipelines and infrastructure for our data engineering solutions on the Microsoft Azure platform. You will collaborate closely with data engineers, data scientists, and other cross-functional teams to ensure the reliability, scalability, and performance of our data pipelines and analytics solutions. You will play a crucial role in designing, implementing, and maintaining our Azure-based data engineering infrastructure Your deep expertise in Azure Data Engineering services and DevOps practices will be instrumental in driving the success of our data initiatives. Key Responsibilities: Design, deploy, and manage Azure data engineering solutions, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other related services. Design, implement, and automate CI/CD pipelines for deploying and managing Azure data engineering solutions, including Azure Data Factory (ADF), Azure Synapse Analytics, Azure Databricks, Azure Data Lake Storage Gen2 (ADLS2), Virtual Networks (VNET), Express Routes, Function Apps, and Logic Apps. Develop automation scripts and infrastructure as code (IaC) templates using tools like PowerShell, ARM templates, Terraform, or Azure DevOps for provisioning and managing Azure resources. Implement and optimize data ingestion, transformation, and processing pipelines to support various data analytics and reporting requirements. Collaborate with data engineers, data scientists, and business analysts to understand data requirements and translate them into scalable and efficient Azure-based solutions. Implement and enforce security, compliance, and governance policies for Azure data engineering resources and pipelines. Monitor system performance, troubleshoot issues, and implement proactive measures to ensure high availability, reliability, scalability, cost-effectiveness and security of data infrastructure. Implement data lifecycle management strategies to ensure efficient storage, retrieval, and archival of data in Azure. Provide technical guidance and support to team members on Azure DevOps tools, practices, and processes related to data engineering. Stay current with industry trends, best practices, and emerging technologies related to Azure data engineering and DevOps methodologies. Qualifications: 10-12+ years of experience as a DevOps Engineer or Systems Administrator, with a focus on Azure cloud technologies. Deep expertise in configuring and administrating Azure Data Engineering resources, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Storage services. Strong proficiency in scripting and automation using PowerShell, Python, or other relevant languages. Experience with infrastructure as code (IaC) tools such as ARM templates, Terraform, or Azure DevOps. Familiarity with Agile/Scrum methodologies and DevOps practices. Excellent problem-solving skills and the ability to troubleshoot complex technical issues. Strong communication and collaboration skills, with the ability to work effectively in a team environment. Bachelor's degree in Computer Science, Engineering, or related field. Good to have Qualifications : Microsoft Azure certifications such as Azure Solution Architect Expert etc. Experience with containerization technologies like Docker and Kubernetes. Understanding of data governance, compliance, and security best practices in cloud environments. Keywords: continuous integration continuous deployment golang trade national Tennessee Azure Infrastructure DEVOPS Engineer (Data Engineering Specialist) || Remote [email protected] |
| [email protected] View all |
| Thu May 09 02:27:00 UTC 2024 |