| Azure Data Engineer with Databricks || Remote || 10+ Years at Remote, Remote, USA |
| Email: [email protected] |
| From: Sharmi, SIF [email protected] Reply to: [email protected] Hi, Hope you are doing good. We have an excellent job openings for the below position, If you are Interested with the job description kindly share me your updated resume and you can give a call to 732-992-3158. Big Data Data Bricks New Jersey, (Remote & Willing to travel) Long Term Contract Job Description: Experience with PySpark or Python Experience with big data tools Spark, Hadoop Kafka would be good to have Hands on experience in Microsoft Azure Data Factory Azure Logic apps service Data Bricks Experience integrating different data sources Should have experience in Azure services e.g. Azure Data factory, Azure Data lake (Gen 2) , Azure SQL, Blob Storage and Azure DevOps, ARM Should have experience in Azure Databricks PySpark , Databricks Delta, n ice to have experience in Scala, Python Experience building data pipeline by using Azure Big data stack Extensive ingesting, cleaning, transformation and aggregation of massive amounts of data from multiple internal and external sources (Salesforce, Google Analytics, etc.) by using Azure Services Create data pipeline that enable various systems within ecosystem to stream high volume data from multiple sources into central repository for processing Reporting at scale enabled by Databrick s Delta for incremental processing Understanding of spark framework and tuning of spark applications Extensive experience with horizontally scalable and highly available system design and implementation, with focus on performance and resiliency Coordinate with all stakeholders and understand the requirement and meet the delivery deadlines Keywords: |
| [email protected] View all |
| Tue Dec 06 16:57:00 UTC 2022 |