| Hiring for Azure databricks Auburn Hills, MI at Auburn, Pennsylvania, USA |
| Email: [email protected] |
| From: Shiv, Teamware Solutions Inc. [email protected] Reply to: [email protected] Hi, Hope! You are doing well. I am Shiv from Teamware Solutions INC. I have below requirements. Please check it and share consultant resume. Role- Azure Data Engineer Location- Auburn Hills, MI Exp.- 10+ Year Project- 12+ Month JD- Develop deep understanding of the data sources, implement data standards, and maintain data quality and master data management. Expert in building Databricks notebooks in extracting the data from various source systems like DB2, Teradata and perform data cleansing, data wrangling, data ETL processing and loading to AZURE SQL DB. Expert in building Ephemeral Notebooks in Databricks like wrapper, driver and config for processing the data, back feeding the data to DB2 using multiprocessing thread pool. Expert in developing JSON Scripts for deploying the Pipeline in Azure Data Factory (ADF) that process the data. Expert in using Databricks with Azure Data Factory (ADF) to compute large volumes of data. Performed ETL operations in Azure Databricks by connecting to different relational database source systems using jdbc connectors. Developed Python scripts to do file validations in Databricks and automated the process using ADF. Analyzed the SQL scripts and designed it by using Pyspark SQL for faster performance. Worked on reading and writing multiple data formats like JSON, Parquet, and delta from various sources using Pyspark. Developed an automated process in Azure cloud which can ingest data daily from web service and load in to Azure SQL DB. Warm Regards:- Shiv Singh/Talent Acquisition E-mail [email protected] | Contact- +1 (248)780-7421 Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd www.teamwaresolutions.net (Team-US IT Recruiter) 2838 E. Long Lake Road Suite 210, Troy, MI 48085 Keywords: access management database information technology Michigan |
| [email protected] View all |
| Thu Sep 07 19:36:00 UTC 2023 |