Urgent Need | Big Data Engineer | New York, NY(Onsite) at New York, New York, USA |
Email: [email protected] |
Hi There, Trust you are doing great! Kindly go through the below mentioned job description Pass me only Local and H1B in NY/NJ Role: Big data Engineer Location: New York, NY(Onsite) Duration: Long term contract Job Description: must have 10+Years A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. Responsibilities: Data ingestion from Source DQ checks Handling ETL Automation Building features / variable Required Skills: Should be subject matter expert in building and designing the ETL pipelines in ADF or ADLS Gen2. Should be able to use Spark, Synapse to process data from Azure data lake Experience in downloading data from UDL & ingesting in PDS. Good experience with ADF. Expert in Spark for structured, semi-structured and un-structured data processing Hands-on knowledge in Azure Databricks or Azure Purview, Synapse Should be clear on designing constructs for different data sets and come up with reusable templates for the same Should have experience of implementing Data Quality methodologies to pre-empt errors in patterns and to identify Data Quality issues . www.envisiontechsol.com 10130 Mallard Creek Rd, Charlotte NC, 28262 Name Satya Prakash Designation Technical Recruiter Envision Technology Solutions E: Email [email protected] Office: number 315-275-5700 LinkedIn : linkedin.com/in/satya-prakash-205335238/ -- Keywords: information technology golang New Jersey New York North Carolina |
[email protected] View all |
Tue Dec 05 21:14:00 UTC 2023 |