| Azure Data Engineer Phoenix, AZ ( Onsite from day 1) at Phoenix, Arizona, USA |
| Email: [email protected] |
| From: sanjeev, HMG America LLC [email protected] Reply to: [email protected] Azure Data Engineer Phoenix, AZ ( Onsite from day 1) Contract Please dont share the profile if already submitted to HCL for any position in the last 3-4 Months Rate is $50/hr Max Please dont share EST or CST Time Zone Candidates Job Description: Develop and maintain data pipelines to ingest, transform, and load data from various sources. Design and manage scalable data lakes to support comprehensive data storage and analysis needs. Design retention, lifecycle, archival policies for datasets Work with Azure Data Lake Storage to efficiently store and manage large datasets. Create and manage data models and data warehouses to support business intelligence and analytics needs. Set up and manage external tables and integrate with various data sources. Utilize Delta Lake for optimized data storage and real-time analytics capabilities. Develop and deploy interactive and visually compelling reports and dashboards using Power BI. Utilize Azure Databricks for advanced data processing. Optimize and manage Azure SQL databases to ensure high performance and availability. Implement CI/CD pipelines using Azure DevOps to streamline development and deployment processes. Ensure data security and compliance with relevant regulations and best practices (eg: NIST). Setup Azure Purview for data governance Experience with data integration and migration from on-premises to cloud environments. Proficiency in Python and experience with Python Notebooks. Proficiency in scripting and automation (Power Shell, ARM templates, Terraform Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus Keywords: continuous integration continuous deployment business intelligence Arizona Azure Data Engineer Phoenix, AZ ( Onsite from day 1) [email protected] |
| [email protected] View all |
| Sat Oct 19 01:02:00 UTC 2024 |