| Urgent requirement for Azure Data Architect - Databricks & Snowflake at 100% Remote at Snowflake, Arizona, USA |
| Email: [email protected] |
| From: Praveen Kumar, Magicforce [email protected] Reply to: [email protected] Job Title: Azure Data Architect - Databricks & Snowflake Location: 100% Remote Duration: 1+ Year Job Description: Responsibilities: - Design, deploy, and manage scalable, secure, and resilient infrastructure on AWS. Develop, maintain, and optimize CI/CD pipelines using Jenkins and other CI/CD tools. Utilize Terraform to define, provision, and manage infrastructure as code. Write and maintain scripts using Bash and Python to automate tasks and improve efficiency. Collaborate with development and operations teams to streamline software development and deployment processes. Implement monitoring solutions to ensure the health and performance of applications and infrastructure. Ensure security best practices are integrated into infrastructure and application development. Troubleshoot and resolve infrastructure and application issues promptly. Continuously evaluate and integrate new tools and technologies to improve DevOps processes. Document processes, configurations, and best practices for knowledge sharing and compliance Mandatory skills / Required Experience 12+ years of experience in implementing large data and analytics platforms. Deep experience architecting and building data platforms on Azure with strong experience on Medallion Architecture. Experience architecting and building data platforms on Databricks from scratch. Proficient in all Databricks engineering services Unity Catalog, Spark Jobs, Delta Live Table (DLT), DLT Meta, Databricks Workflow, Auto Loader. In-depth experience with data governance, data integration and related technologies. Hands on in Databricks SQL, PySpark Expertise in data modelling, data mappings, understand the data model changes and propose the best practices and guidelines. Creating technical design based on end-to-end data architecture and frameworks for meta data driven data ingestion, transformation, logging and monitoring. Deploying data pipelines/applications to higher environments using CI-CD pipelines. Experience in writing technical user stories and worked in Agile methodology and scrums. Excellent communication, presentation and client handling skills written and verbal Keywords: continuous integration continuous deployment Urgent requirement for Azure Data Architect - Databricks & Snowflake at 100% Remote [email protected] |
| [email protected] View all |
| Fri Sep 06 00:43:00 UTC 2024 |