| Job opening for Azure Databricks Developer - Canonsburg, PA - Remote at Canonsburg, Pennsylvania, USA |
| Email: [email protected] |
| From: John, Mindfore [email protected] Reply to: [email protected] Position: Azure Databricks Developer Location: Remote (Canonsburg, PA) Exp: 14+ years Note: This will be remote opportunity, But occasional travel like once a month to client location will be required. Responsibilities: 10+ years of experience in implementing large data and analytics platforms. 5+ years of experience architecting and building data platforms on Azure. 5+ years of experience architecting and building data platforms on Databricks from scratch. Good Knowledge in Databricks engineering services like Unity Catalog, Spark Jobs, Delta Live Table (DLT), DLT Meta, Databricks Workflow, Auto Loader. Hands on in Databricks SQL, PySpark Understanding of data modelling, data mappings, understand the data model changes and propose the best practices and guidelines. Creating technical design based on end-to-end data architecture and frameworks for meta data driven data ingestion, transformation, logging and monitoring. Deploying data pipelines/applications to higher environments using CI-CD pipeline Experience in writing technical user stories. Experience in Agile methodology and scrums. Minimum Qualifications: Bachelor's Degree or Master's Degree in the field of Computer Science or Information Systems or a related field. Preferred Qualifications: Design Azure Databricks platform architecture from scratch. Design and build ingestion framework, data processing framework, logging & monitoring framework and, data sharing framework. Share Databricks best practices. Develop data models in different layers of Databricks. Design, build and orchestrate data pipelines in Azure and Databricks Define strategy for configuration management and CI/CD Keywords: continuous integration continuous deployment Pennsylvania Job opening for Azure Databricks Developer - Canonsburg, PA - Remote [email protected] |
| [email protected] View all |
| Wed May 08 01:50:00 UTC 2024 |