Urgent Requirement - Data Engineer ( Pyspark + Azure Data Bricks )- Remote at Remote, Remote, USA |
Email: [email protected] |
From: Ben, Spar Info Sys [email protected] Reply to: [email protected] Job Title: Data Engineer ( Pyspark + Azure Data Bricks ) Duration: 6-12+ months Open to C2C Location is Remote (CST working time) Job Description This is Data Engineer ( Pyspark + Azure Data Bricks ) Mandatory Skill - Data Engineering, Sql, Azure Databricks, Pyspark Job responsibilities Design, build and deploy efficient & reliable data pipelines to move and transform data Optimize existing pipelines and maintenance of all source-related data pipelines Support on-call shift as needed to support the team Build and Deploy extensive data quality checks to ensure high quality of data Build high-performance scalable data warehouses and data products Partner with leadership, engineers, product managers and data scientists to understand data needs. Improve existing data movement frameworks and add more features Expert level Pyspark skills Data Modeling CI/CD Pipeline and DevOps practices Agile fundamentals Keywords: continuous integration continuous deployment Urgent Requirement - Data Engineer ( Pyspark + Azure Data Bricks )- Remote [email protected] |
[email protected] View all |
Wed Apr 03 00:15:00 UTC 2024 |