| Job Title:Azure Data Engineer 10+ Years -- Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: peter, vsiiusa [email protected] Reply to: [email protected] Job Title: Azure Data Engineer 10+ Years Location: Remote Humana - Healthcare Job Description: Hanuma (Humana) is seeking an experienced Azure Data Engineer with a strong background in healthcare (specifically Pharmacy Benefit Management). The role involves working with Python as an ETL tool, handling data transformations, error management, logging, and loading data into Databricks-managed Delta tables. The ideal candidate will be proficient in Azure services and have expertise in Databricks and PySpark. Key Responsibilities: Develop and manage ETL processes using Python, ensuring data transformation, error handling, and logging. Work with Databricks and PySpark for large-scale data processing and transformations. Leverage Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Build and optimize data pipelines for large-scale infrastructures. Work with cloud data storage formats and technologies such as Data Lakes and Cloud Warehouses. Lead data engineering projects and contribute to the strategic design of data workflows. Required Skills and Experience: 6+ years of experience in data engineering. Proficient in Python, including working with classes, methods, dictionaries, loops, wheel files, and packages. Solid experience with Databricks, PySpark, and Apache Spark for data transformations. Extensive experience with Azure services such as Azure SQL Database, Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Experience with ETL processes and data modeling, particularly for large-scale data pipelines. Familiarity with Unix scripting and scheduling tools. Strong knowledge of cloud data warehousing, data lakes, and various storage formats. Experience leading or managing data engineering projects. Additional Qualifications (Preferred): Expertise in Spark and Scala. Experience with Azure Cloud infrastructure and related technologies. Peter VisionSoft International Inc (www.vsiiusa.com ) Email : [email protected] Keywords: Job Title:Azure Data Engineer 10+ Years -- Remote [email protected] |
| [email protected] View all |
| Thu Dec 12 23:36:00 UTC 2024 |