| Remote Lead Azure Databricks Engineer Contract at Remote, Remote, USA |
| Email: [email protected] |
| From: Durgesh Kumar Jha, Gtech [email protected] Reply to: [email protected] Hello Hope you are doing well. Position: Lead Azure Databricks Engineer Location: Remote Job type: Contract Job description: - Job Description Pls send profiles matching below skills Performance tuning in Spark and oracle Handled about 10 TB datawarehouse Databricks architecture Oracle partition, indexing, bulk collect Surrogate key, Natural keys Version control in databricks Identity columns in databricks ADLS Python SQL Must Have: 12+ years of experience in the IT/Technology and having atleast 4+ years of experience in Azure Databricks Hands on experience in development of Azure cloud DWH & datalakes using Azure technologies like Spark (Scala or Python), ADF, Azure Databricks, Terraform & CI/CD. Strong programming skills in Pyspark, Python, writing complex queries in Postgresql, T-SQL 7+ years of experience in coding complex U-SQL, Spark (Scala or Python). T-SQL, postgresql Should have experience in Azure Storages like ADLS Gen2, Azure Postgresql Design and develop automation to support continuous delivery and continuous integration process when it comes to cloud infrastructure. Work closely with the Development and Operations teams to build and maintain CI/CD pipelines to support automated deployment of infrastructure (DevOps) and Infrastructure as Code (IaC) using Terraform and Enterprise Github Understanding of Azure Database technologies (both IaaS and PaaS) and options to support the migration process. This will include and not limited to Azure database migration technologies and refactoring options. Build effective monitoring, logging and auditing of production systems to ensure compliance with mandated compliance policies (e.g., HIPAA). Must have experience in Azure Kubernetos. Good to have: Event hub, Data streaming Data Encryption Knowledge of SQL Server, Oracle etc. other databases is a plus. Azure Certifications are plus Keywords: continuous integration continuous deployment information technology Remote Lead Azure Databricks Engineer Contract [email protected] |
| [email protected] View all |
| Thu Sep 19 18:59:00 UTC 2024 |