| LOOKING FOR DATA engineer Chicago(Naperville), IL ONSITE at Chicago, Illinois, USA |
| Email: [email protected] |
| From: jayaprakash, kksoftwareassociates.com [email protected] Reply to: [email protected] Title:DATA engineer Location: Chicago(Naperville), IL-ONSITE Contract Duration:12 months (+ Extension) ONLY H1B PASSPORT NUMBER IS MANDAYTORY Role Description: Work in Agile development projects for batch and real time data ingestion, transformationWork closely with product owners, understand requirements, lead offshore team on Development and QE of data pipelinesWork with upstream/downstream teams to resolve any issues/blockersWork with System Integration/Performance engineering team for integration/performance testing of data pipelinesCoordinate with DevOps/RunOps teams for deployment in higher environments Competencies: Digital : Apache Spark, Digital : Scala, Digital : Databricks Essential Skills: Minimum 4-6 years of experience in Data Warehousing and Analytics Minimum 3-4 years of experience on Spark with Scala / Azure Databricks Hands on experience of building data pipelines using Apache Spark (Azure Databricks), Scala Hands on experience working on Databricks batch. Hands on experience in Azure Data Factory. Hands on experience in designing and delivering solutions using the Azure Data Analytics platform including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Experience working on Delta Lakes. Experience working in a Dev/Ops environment with tools such as Azure DevOps Should be able to work independently on assigned projects with offshore team. Desirable Skills: Knowledge of Talend Tool. Exposure to Azure PaaS services is highly desirable. Problem-solving and good analytical skills Communication, teamwork and negotiation skills 4693253594 [email protected] Keywords: Illinois |
| [email protected] View all |
| Tue Feb 13 20:27:00 UTC 2024 |