Data Platform Engineer at Remote, Remote, USA |
Email: [email protected] |
From: Manoj, Nitya Software Solutions [email protected] Reply to: [email protected] Data Platform Engineer with Azure Databricks and Unity Catalog. Seattle based client 10-12 months Visa -any Seattle WA We will prefer local candidates or candidates who can relocate We are also fine with REMOTE candidate if he is a ROCK STAR Core skills needed - Data Platform Engineer with Databricks and Unity Catalog. Experience 9+ years Design and implement data architecture leveraging technologies such as Azure Databricks. Set up Unity Catalog ,- Should have specific experience setting up Unity Catalog Good to have Privacera, and Collibra. Develop, optimize, and manage data pipelines for ETL processes using azure Databricks, with a focus on data integrity and quality. Design and maintain data models and schemas, incorporating Unity Catalog and Collibra data governance practices. Ensure data security and compliance with regulations using Databricks . Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices. Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups. Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions. Keywords: Washington |
[email protected] View all |
Wed Mar 20 03:53:00 UTC 2024 |