| Azure Data Architect - Hybrid at Princeton, New Jersey, USA |
| Email: [email protected] |
| From: Nadeem Ahmed Razvi, Msys Inc [email protected] Reply to: [email protected] Title: Azure Data Architect - Hybrid Location: Princeton, NJ, USA/New York City, NY Length: Long term Restriction: W2 or C2C Send resume to: [email protected] Description: **** Webcam interview; *** Long term project *** Hybrid **** Job Description: Key Responsibilities Design & Develop the ETL Good experience in writing SQL, Python and Pyspark programming Create the Pipelines (simple and complex) using ADF. Work with other Azure stack modules like Azure Data Lakes, SQL DW Must be extremely well versed with handling large volume of data. Understand the business requirements for Data flow process needs. Understand requirements, functional and technical specification documents. Development of mapping document and transformation business rules as per scope and requirements/Source to target. Responsible for continuous formal and informal communication on project status Good understanding of JIRA stories process for SQL development activities Required Skills: Overall, 4+ years of developer skills with SQL, Python with Spark (Pyspark) Experience in Azure Data Factory, Data Sets, Data Frame, Azure Blob & Storage Explorer Implement data ingestion pipelines from multiple data sources using ADF, ADB (Azure data bricks) Experience in creating Data Factory Pipelines, custom Azure development, deployment, troubleshoot data load / extraction using ADF. Extensive experience on SQL, python, Pyspark in Azure databricks. Able to write Python code in Pyspark frame by using Dataframes. Have good understanding on Agile/Scrum methodologies. Keywords: wtwo New Jersey New York Azure Data Architect - Hybrid [email protected] |
| [email protected] View all |
| Wed Jul 17 23:39:00 UTC 2024 |