| Lead Azure Databricks Engineer at 100% Remote role at Remote, Remote, USA |
| Email: [email protected] |
| From: Vinkal Dhaka, Siri Info [email protected] Reply to: [email protected] H1B candidate required.Passport number is mandatory for i94. Lead Azure Databricks Engineer Remote 100% Contract/C2C Job Description Pls send profiles matching below skills Performance tuning in Spark and oracle Handled about 10 TB Datawarehouse Databricks architecture Oracle partition, indexing, bulk collect Surrogate key, Natural keys Version control in data bricks Identity columns in data bricks ADLS Python SQL Must Have: 8+ years of experience in the IT/Technology and having at least 3+ years of experience in Azure Databricks Hands on experience in development of Azure cloud DWH & data lakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD. Strong programming skills in Pyspark, Python, writing complex queries in PostgreSQL, T-SQL 6+ years of experience in coding complex U-SQL, Spark (Scala or Python). T-SQL, PostgreSQL Should have experience in Azure Storages like ADLS Gen2, Azure PostgreSQL Design and develop automation to support continuous delivery and continuous integration process when it comes to cloud infrastructure. Work closely with the Development and Operations teams to build and maintain CI/CD pipelines to support automated deployment of infrastructure (DevOps) and Infrastructure as Code (IaC) using Terraform and Enterprise Github Understanding of Azure Database technologies (both IaaS and PaaS) and options to support the migration process. This will include and not limited to Azure database migration technologies and refactoring options. Build effective monitoring, logging and auditing of production systems to ensure compliance with mandated compliance policies (e.g., HIPAA). Must have experience in Azure Kubernetes. Good to have: Event hub, Data streaming Data Encryption Knowledge of SQL Server, Oracle etc. other databases is a plus. Azure Certifications are plus Keywords: continuous integration continuous deployment information technology Lead Azure Databricks Engineer at 100% Remote role [email protected] |
| [email protected] View all |
| Wed Sep 18 22:55:00 UTC 2024 |