| Urgent Required Databricks Engineer Location: Jacson, MI (Onsite) at Remote, Remote, USA |
| Email: [email protected] |
| From: Sarvan Kumar, Rivago infotech [email protected] Reply to: [email protected] Role: Databrick Engineer Location: Jacson, MI (Onsite) Duration: Long term Project JD: Strong hands on in Pyspark and Apache Spark Strong hands on in Medallion architecture Experience in Native Spark Migration to Databricks. Experience in Building Data Governance Solutions like Unity Catalog, Azure Purview etc. Highly experienced in Usability Optimization (Auto Compaction, ZOrdering, Vaccuming), Cost Optimization and Performance Optimization. Build Very Strong Orchestration Layer in Databricks/ADF. Workflows. Build CICD for Databricks in Azure Devops. Process near Real time Data thru Auto Loader, DLT Pipelines. Implement Security Layer in Delta Lake. Implement Massive Parallel Processing Layers in Spark SQL and PySpark. Implement Cost effective Infrastructure in Databricks. Experience In extracting logic and from on prem layers, SAP, ADLS into Pyspark/ADLS using ADF/Databricks. Keywords: Michigan Urgent Required Databricks Engineer Location: Jacson, MI (Onsite) [email protected] |
| [email protected] View all |
| Tue May 07 01:44:00 UTC 2024 |