| Senior Azure Data Engineering Opportunity in Chicago Heights, IL - Onsite. at Chicago, Illinois, USA |
| Email: [email protected] |
| Hello, Role: Data Engineering Work location: Chicago Heights (US:60411), IL Duration: 6-12months We need only Senior profile 15+ JOB DESCRIPTION: Must Have skills: 10+ years of experience in implementing large data and analytics platforms. 5+ years of experience architecting and building data platforms on Azure. 5+ years of experience architecting and building data platforms on Databricks from scratch. Pro in all Databricks engineering services Unity Catalog, Spark Jobs, Delta Live Table (DLT), DLT Meta, Databricks Workflow, Auto Loader. Hands on in Databricks SQL, PySpark. Understanding of data modelling, data mappings, understand the data model changes and propose the best practices and guidelines. Creating technical design based on end-to-end data architecture and frameworks for meta data driven data ingestion, transformation, logging and monitoring. Deploying data pipelines/applications to higher environments using CI-CD pipelines. Experience in writing technical user stories. Experience in Agile methodology and scrums. Communication: Excellent communication, presentation and client handling skills written and verbal. Should be able to drive technical discussions with client & partners and share technical thought leadership in architecture and design discussions Key responsibilities: Design Azure Databricks platform architecture from scratch. Design and build ingestion framework, data processing framework, logging & monitoring framework and, data sharing framework. Share Databricks best practices. Develop data models in different layers of Databricks. Design, build and orchestrate data pipelines in Azure and Databricks. Define strategy for configuration management and CI/CD Perform POCs Please let me know if you would like to discuss this compelling opportunity further. If the opportunity above isnt the right fit for you at the moment, but know someone in your network that may be looking for this type of role, I would love to connect with them. Best wishes to you and your family during this unprecedented time. Thanks, Mansi Kukreja Technical Recruiter Direct#: (925) 393- 5851 [email protected] www.axiomglobal.com Integrity. Expertise. Results . -- Keywords: continuous integration continuous deployment information technology Illinois |
| [email protected] View all |
| Wed Dec 20 03:06:00 UTC 2023 |