| Hiring Now :: AWS Databricks Platform Administrator :: Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Amit Kumar Pradhan, Vyze Inc. [email protected] Reply to: [email protected] Job Description - Job Title: AWS Databricks Platform Administrator Location: Remote (USA) Duration: 6 months+ Position Overview: The AWS Databricks Platform Administrator is a technical role focused on designing, implementing, and maintaining processes to manage the organizations Databricks platform. The administrator will ensure smooth operation, facilitate collaboration among data analysts, engineers, and scientists, and uphold security and compliance standards using Unity Catalog for access and identity policies. Infrastructure management will be handled through Terraform. The role involves resolving compute issues, monitoring performance, and ensuring smooth platform functionality. Strong organizational and communication skills are essential. Job Responsibilities: Manage and maintain role-based access to data and features within the Databricks Platform using Unity Catalog. Implement external access controls for outside teams via service principles, SQL warehouses, and Delta Sharing. Collaborate with platform users to troubleshoot problems and enable their work. Use Terraform to create AWS infrastructure for Databricks, including S3, IAM roles, Instance Profiles, and KMS Keys. Enhance processes and systems for managing infrastructure, users, and external access. Track and prune unused assets. Ensure best practices for security and compliance are followed. Set up service principles and access tokens for external users. Utilize Databricks APIs to automate administrative tasks. Create and manage queries and dashboards to monitor critical systems and processes. Develop documentation for platform users and administrators. Automate recurring admin tasks using Databricks notebooks. Enforce workflow tags, cluster tags, and workflow naming conventions. Conduct health checks for clusters and ensure best practices are implemented. Perform regular backup and recovery tasks. Conduct privilege reviews on users and resources. Required Qualifications: 4+ years of experience in administering the Databricks platform. Strong understanding of data engineering needs. Experience with creating AWS infrastructure using Terraform. In-depth knowledge of AWS infrastructure required by Databricks. Experience with compliance audits and related documentation. Proficiency in using Databricks APIs, with tools like Postman. Familiarity with the Databricks workspace and development environment. Experience with GitHub for source code management. Strong SQL skills for crafting admin-related queries and dashboards. Strong debugging and troubleshooting skills. Ability to perform risk analysis for third-party integrations with AWS resources. Python knowledge is a plus. Familiarity with Datadog for monitoring is a plus. Keywords: sthree Hiring Now :: AWS Databricks Platform Administrator :: Remote [email protected] |
| [email protected] View all |
| Thu Aug 29 05:26:00 UTC 2024 |