| Need for Data Engineer LOCAL DL Copy MUST - Michigan at Jackson, Michigan, USA |
| Email: [email protected] |
| From: shyam, 4 serve [email protected] Reply to: [email protected] Client: Consumers Energy Job Title: Data Engineer I Location: Jackson, MI **For this position we prefer to have a candidate that is local to Jackson. They will be expected to work on-site three days per week (Mon, Tues, Thurs) as this is a hybrid position. They can work remote the other two days each week.** Data Engineer I #994124 Duties: As an Azure Data Engineer, your role involves designing, implementing, monitoring, and maintaining data and analytical solutions on Microsoft Azure. Data Pipeline Design and Implementation: Create and maintain data pipelines that facilitate data movement, transformation, and integration. Ensure efficient and reliable data flow from source systems to target destinations. Data Storage Solutions: Design and manage data storage solutions within Azure, including: Azure Data Lake: Storing large volumes of raw data. Azure SQL Database: Providing structured data storage. Azure Blob Storage: Handling unstructured data. Data Processing and Transformation: Use tools like Databricks and dbt to process and transform data. Leverage Azure Databricks for running dbt transformations in production Data Integration: Collaborate with data analysts and scientists to understand data requirements. Design effective data workflows that enable data-driven decision-making. Performance Optimization: Optimize SQL queries generated by dbt for better performance. Ensure consistency between development (using a Databricks SQL warehouse) and production (using Azure Databricks compute) environments Security and Compliance: Implement secure and compliant data processing pipelines. Use Azure services and frameworks to produce cleansed and enhanced datasets for analysis Skills: Microsoft Azure, Azure Databricks, and DBT Knowledge of data catalog tools (e.g., Microsoft Purview) Proficiency in data processing languages, including SQL and Python Excellent problem-solving skills and ability to work in a collaborative environment Education: Bachelors degree in Computer Science, Engineering, or related field. Experience as an Azure Data Engineer or similar role. Certifications & Licenses: Proficiency in data processing languages, including SQL and Python Skills Required: Microsoft Azure Problem-Solving Data Pipelines Python SQL Additional skills: Datasets Performance Optimization SQL Queries Data Integration Keywords: Michigan Need for Data Engineer LOCAL DL Copy MUST - Michigan [email protected] |
| [email protected] View all |
| Mon Jul 15 20:22:00 UTC 2024 |