| Sr. Azure Data Engineer (Databricks) - 15+ yrs only at Remote, Remote, USA |
| Email: [email protected] |
| From: Sandeep Bisht, Key Infotek [email protected] Reply to: [email protected] Remote The Data Management Platform (DMP) is a major initiative at Client, it has been created for centralized data collection to analyze Client data and help propel Client into data driven organization. DMP is built entirely on Azure services and Databricks, and while its a very stable product which meets current needs, Client is looking to take advantage of improvements in technology and evolving requirements to enhance it for the future to operate in a federated model. We are looking for experts in the Data space to help us in the areas of technical architecture design, configuration & implementation. Focus is drive DMP to domain driven platform with capabilities to self-service data movement, data quality and sharing of data to internal/external entities. High level responsibilities for this position include: Architecting Microsoft Azure/Databricks/Off the shelf tools for DMP to meet current and future needs of Client Technical lead who can co-ordinate/guide Platform, Ingestion, DQ and Ops & Support teams Provide technical guidance on technologies and architecture challenges Implemented Domain driven Data Architecture for other organizations Familiar with Data mesh and federating data consumption from source Refine Ingestion process and enable self-service capabilities for Data Producer Enhance Data quality of data ingested into DMP by adding additional checks Review and provide feedback on core Platform code changes and support production deployments Update security plan manager (SPM) for DMP and manage releases with team Participate in team Scrum ceremonies and hands-on keyboard for Product deliverables Able to communicate technical roadmap/architecture to broad set of users Comfortable working cross functionally with product management and directly with Client teams Certified in Databricks and abreast with features of Databricks (Databricks CLI, Asset Bundles, Terraform module, API) Technical skills: Python, SQL Server, Databricks Unity catalog, Databricks API, PySpark, Stored procedures, Azure Data Factory, Databricks, Terraform module, Terraform, Azure DevOps, GitHub, T-SQL, Synk, DataDog, Azure Data Lake Storage, Azure Service Bus, Azure Event Grid, Azure App Insights, Azure Kubernetes Service, GitHub actions, and Azure Cosmos DB Note: Someone who knows and guides the team on upcoming Azure Tech. like Unity catalog, Delta sharing, liquid clustering, and data Keywords: database information technology Colorado |
| [email protected] View all |
| Fri Sep 22 19:35:00 UTC 2023 |