| Urgent Need | Lead Big Data Engineer | New York City, NY(Onsite) at York, New York, USA |
| Email: [email protected] |
| Hi There, Trust you are doing great! Kindly go through the below mentioned job description Role: Lead Big Data Engineer Location: New York City, NY (Onsite) Duration: Long term contract Must have 10+Years Job Description: A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. Responsibilities: Data ingestion from Source DQ checks Handling ETL Automation Building features / variable Required Skills: Should be subject matter expert in building and designing the ETL pipelines in ADF or ADLS Gen2. Should be able to use Spark, Synapse to process data from Azure data lake Experience in downloading data from UDL & ingesting in PDS. Good experience with ADF. Expert in Spark for structured, semi-structured and un-structured data processing Hands-on knowledge in Azure Databricks or Azure Purview, Synapse Should be clear on designing constructs for different data sets and come up with reusable templates for the same Should have experience of implementing Data Quality methodologies to pre-empt errors in patterns and to identify Data Quality issues. www.envisiontechsol.com 10130 Mallard Creek Rd, Charlotte NC, 28262 Name Satya Prakash Designation Technical Recruiter Envision Technology Solutions E: Email [email protected] Office: number 315-275-5700 LinkedIn : linkedin.com/in/satya-prakash-205335238/ -- Keywords: information technology golang New York North Carolina |
| [email protected] View all |
| Fri Dec 01 21:19:00 UTC 2023 |