Opening for Databricks Engineer: No H1B or CPT at Remote, Remote, USA |
Email: [email protected] |
From: Anamika, RCI [email protected] Reply to: [email protected] Role: Databricks Engineer Duration: 6-12 months (starting in January 2023) 100% remote [PST] No H1B and CPT Kellys notes / JD: Just got off a call with a client and he would like help with a consultant who can hit the ground running looking for strong terraform and Databricks skills plus the usual stuff (Sql, python, Spark) Must be Data Bricks Certified Ideally: 5+ years of experience in performing Azure Databricks administration activities. YOUR SKILLS & EXPERIENCE: Degree educated in a numerical discipline (computer science or relevant field) Professional experience developing pipelines in an AWS environment Must be a hands-on developer with Scala or Python Databricks and Terraform experience is a must-have Experience with design and architecture Further responsibilities include: Working with Scala or Python, Databricks, and Terraform Developing scalable pipelines Adapting to scale and change within a startup environment Working with stakeholders on design, and strategy definition Sample activities 1. Setup Databricks infrastructure using terraform script and CI/CD pipeline. Infrastructure resources includes resource group, VNET, Databricks workspace, log analytics workspace, etc 2. Monitor existing infrastructure and in case of any issue resolve it 3. Resolve performance problem reported by user 4. Onboard new users by helping them to setup LDAP group and assign permission at databricks cluster level. 5. Create cluster policies for newly onboarded team. Migrate users and their job, notebooks from different subscription to our subscription. 6. creation of Dashboards Keywords: continuous integration continuous deployment information technology |
[email protected] View all |
Wed Dec 28 17:52:00 UTC 2022 |