| Azure Databricks Architect- Remote at Remote, Remote, USA |
| Email: [email protected] |
| Hello My name is Shubham and I am a Recruitment lead at Sureminds Solution. I am reaching out to you on an exciting job opportunity with one of our clients. Role: Azure Databricks Architect- Location: Remote Key Responsibilities: Overview: The Databricks Architect will serve as a technical thought leader and Subject Matter Expert (SME) for our public cloud ecosystem of partners, customers, and service providers. You will plan, analyze, design, test, and deploy enterprise-scale Databricks solutions while collaborating with key stakeholders to achieve business goals. You will work with 2-3 scrum teams executing the roadmap and will be responsible for designing and developing innovative data solutions. Key Responsibilities: Serve as a technical SME for Databricks solutions within public cloud environments (AWS, Azure, or GCP). Plan, design, and deploy enterprise-scale Databricks solutions. Build relationships with key customer stakeholders to help them achieve their business goals. Collaborate with 2-3 scrum teams to execute the roadmap and deliver on project milestones. Provide reference architecture and guidelines for technology adoption, emphasizing cloud migration and data modernization. Lead the design and implementation of data artifacts, including data modeling, data integration, data storage, and data governance. Develop and maintain optimal ETL/ELT pipelines using technologies like Azure Data Factory and Databricks. Ensure solutions align with industry best practices, governance, and architectural standards. Act as a mentor and trainer to the development team, ensuring an adequate supply of skilled resources. Participate in industry forums, submit whitepapers, and file patents to drive thought leadership. Requirements: 15+ years of industry experience building and supporting large-scale cloud systems. Minimum of 7 years of experience with Databricks, including expertise in Databricks, Spark, PySpark, Hadoop, Delta Lake, and Kafka. Strong knowledge in Data Engineering, Data Vault, Dimensional modeling, and OLAP design. Experience building Databricks solutions with cloud providers like AWS, Azure, or GCP. Proficiency in a variety of data technologies (relational and non-relational databases). Extensive experience with CI/CD platforms such as GitLab CI, GitHub Actions, AWS CodeBuild, Azure Pipelines, and Jenkins. Skilled in scripting languages like Python, Bash, and PowerShell. Familiarity with log and monitoring solutions. Strong understanding of data governance, data integration, and related technologies. Experience utilizing development containers and best practices for unit testing, code quality, and linting. Familiarity with containerization and orchestration technologies. Expertise in version control systems. Power BI experience is an advantage. Databricks certification is preferred. Qualifications: Bachelor's or higher degree in Computer Science, Information Technology, or a related field. Proficiency in Python and SQL for data transformation and querying. Strong analytical, problem-solving, and troubleshooting abilities. Excellent communication and collaboration skills. -- Keywords: continuous integration continuous deployment access management business intelligence information technology Azure Databricks Architect- Remote [email protected] |
| [email protected] View all |
| Fri Oct 18 19:04:00 UTC 2024 |