| Data Engineer:Deerfield IL, Local -Travel is fine (Need profile with 50 mil radius) at Fine, New York, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=736500&uid= From: umamahesh, HCL Global System [email protected] Reply to: [email protected] Job Title Data Engineer Location: Deerfield IL, Local / Travel is fine (Need profile with 50 mil radius) Mandatory Skills:Data Engineering,Azure,Azure Data Factory Description: Data Engineers: Azure Cloud Experience. Data pipeline development, ETL experience, Azure data factory, Azure streams analytics, Azure Blob Storage, Azure data Lake, Batch & real-time data ingestion design and implementation experience, Hadoop, Hive, Cloudera Data Platform Experience, Kafka experience. Agile project experience Responsibilities: As a Data Engineer you: Should be able to work with other professionals to ensure successful implementation of proposed designs and completion of projects. Should be responsible for the development, and integration of computer programs. Should understand the business needs and works strictly in compliance with the needs of the client. Requirements: 3-5 years experience developing data centric applications in Azure 3-5 years ETL/ELT development with Azure data tools including Azure Data Factory and Databricks. 3-5 years experience creating data transformation and validation logic within Azure Data Factory using Mapping and Wrangling activities. Advance knowledge of any programming language (Python/PySpark) Advanced knowledge of data formats (JSON, XML, Parquet, etc.) and data modeling practices. Strong knowledge of debugging and performing tuning Azure Data Factory pipelines and runtime environments. Deep understanding of Azure data storage technologies such as Azure Blob Storage, Azure Data Lake Gen2, Synapse, Azure SQL and the frameworks applied to each. Data modelling experience shaping and transforming data into third normal form and dimensional models. Advanced understanding of best practices for structuring and organizing Data Lake file systems for large volumes of data. Knowledge of big-data ecosystems such as Hadoop, Hive, Sqoop, Cloudera Data Platform. Keywords: Illinois http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=736500&uid= |
| [email protected] View All |
| 01:06 AM 11-Oct-23 |