| Azure Data Engineer-USC ONLY at Remote, Remote, USA |
| Email: [email protected] |
| From: ayush, Scalable Systems [email protected] Reply to: [email protected] Job Description: Azure Data Engineer - USC ONLYJob Summary We are seeking a highly skilled Azure Data Engineer to join our team in Seattle, WA. This is an ITAR-restricted position requiring a US Citizen candidate. The successful candidate will be responsible for designing, developing, and maintaining complex data pipelines on the Azure platform.Key Responsibilities Build and maintain robust and efficient data pipelines using Azure Databricks, Azure Data Factory, and other relevant tools. Develop and optimize SQL queries for data extraction, transformation, and loading (ETL) processes. Collaborate with data engineers, data analysts, and business stakeholders to understand data requirements and translate them into technical solutions. Create and maintain Azure infrastructure components such as Storage Accounts, Key Vaults, Virtual Machine Scale Sets, and more using ARM templates. Implement data governance and security best practices to protect sensitive data. Troubleshoot and resolve data pipeline issues in a timely manner.Required Skills and Experience Proficiency in Python and PySpark for data manipulation and analysis. Strong SQL skills for data querying and manipulation. Hands-on experience with Azure Databricks for big data processing. In-depth knowledge of Azure components and services including Storage Account, Azure Data Factory, Active Directory, Synapse, Key Vault, VMSS, Function apps, web apps, Log analytics workspace, Service principal, managed identity, ACR, and container instances. Understanding of Azure networking services and infrastructure creation using ARM templates. Experience with GitLab and Azure DevOps for version control and CI/CD. Excellent problem-solving and analytical skills. Strong communication and collaboration abilities.Preferred Skills Experience with data warehousing and data modeling. Knowledge of machine learning and AI concepts. Certifications in Azure or related technologies. Keywords: Azure Data Engineer, Databricks, Azure, Python, PySpark, SQL, ETL, data pipelines, Azure Databricks, Azure Data Factory, ITAR, Keywords: continuous integration continuous deployment artificial intelligence Washington Azure Data Engineer-USC ONLY [email protected] |
| [email protected] View all |
| Wed Aug 14 01:12:00 UTC 2024 |