| Urgent requirement for Lead Azure DATA Engineer, Databricks & Snowflake at Remote at Snowflake, Arizona, USA |
| Email: [email protected] |
| From: Praveen Kumar, Magicforce [email protected] Reply to: [email protected] Job Title: Azure DATA Engineer, Databricks & Snowflake Location: (00% Remote Duration: 1+ Year Job Description: Responsibilities: - Design, deploy, and manage scalable, secure, and resilient infrastructure on AWS. Develop, maintain, and optimize CI/CD pipelines using Jenkins and other CI/CD tools. Utilize Terraform to define, provision, and manage infrastructure as code. Write and maintain scripts using Bash and Python to automate tasks and improve efficiency. Collaborate with development and operations teams to streamline software development and deployment processes. Implement monitoring solutions to ensure the health and performance of applications and infrastructure. Ensure security best practices are integrated into infrastructure and application development. Troubleshoot and resolve infrastructure and application issues promptly. Continuously evaluate and integrate new tools and technologies to improve DevOps processes. Document processes, configurations, and best practices for knowledge sharing and compliance Mandatory skills / Required Experience 12+ years of experience in implementing large data and analytics platforms. Deep experience architecting and building data platforms on Azure with strong experience on Medallion Architecture. Experience architecting and building data platforms on Databricks from scratch. Proficient in all Databricks engineering services Unity Catalog, Spark Jobs, Delta Live Table (DLT), DLT Meta, Databricks Workflow, Auto Loader. In-depth experience with data governance, data integration and related technologies. Hands on in Databricks SQL, PySpark Expertise in data modelling, data mappings, understand the data model changes and propose the best practices and guidelines. Creating technical design based on end-to-end data architecture and frameworks for meta data driven data ingestion, transformation, logging and monitoring. Deploying data pipelines/applications to higher environments using CI-CD pipelines. Experience in writing technical user stories and worked in Agile methodology and scrums. Excellent communication, presentation and client handling skills written and verbal Educational Qualifications: - Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable. Keywords: continuous integration continuous deployment Urgent requirement for Lead Azure DATA Engineer, Databricks & Snowflake at Remote [email protected] |
| [email protected] View all |
| Thu Aug 15 19:49:00 UTC 2024 |