| Job Opening! Big Data Engineering lead || New Yok || Contract at Remote, Remote, USA |
| Email: [email protected] |
| From: Priyanka, Smart IT Frame [email protected] Reply to: [email protected] Dear, Greetings from Smart IT Frame, Hope you are doing well!!! This is Priyanka from Smart IT Frame, We have an excellent opening for the below role, Job Title: Big Data Engineering lead Work Location : USA New York Contract Job Description: A Big Data Engineering lead handles the ETL jobs, Optimization, Automation of data processing for complex scenarios. Responsibilities: Data ingestion from Source DQ checks Handling ETL Automation Building features / variable Required Skills: Should be subject matter expert in building and designing the ETL pipelines in ADF or ADLS Gen2. Should be able to use Spark, Synapse to process data from Azure data lake Experience in downloading data from UDL & ingesting in PDS. Good experience with ADF. Expert in Spark for structured, semi-structured and un-structured data processing Hands-on knowledge in Azure Databricks or Azure Purview, Synapse Should be clear on designing constructs for different data sets and come up with reusable templates for the same Should have experience of implementing Data Quality methodologies to pre-empt errors in patterns and to identify Data Quality issues. Warm Regards, Priya Sr. Technical Recruiter Smart IT Frame LLC email: [email protected] LinkedIn: https://www.linkedin.com/in/priyanka-murugesan-0ba9a422b/ Keywords: information technology |
| [email protected] View all |
| Thu Nov 30 22:28:00 UTC 2023 |