| Azure Data Engineer at Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Devyani Kumari, Absolute IT [email protected] Reply to: [email protected] Azure Data Engineer Remote Rate we have $48/hr on C2C lastly Duties and Responsibilities: Youll be part of a team delivering data driven revolution to the workplace experience and empowering each employee with augmented decision making. It is an exciting and multifaceted data driven project that needs a talented and driven data engineer to make it all work. Collecting and formulating business requirements and design solution architecture and Data pipeline. Design Data Pipeline solutions for the enterprise using the Microsoft Azure data platform including ETL and EL processes for complex datasets. Experience in development of data pipelines for both real time and batch data on Azure platform covering structured and unstructured data. Automation of ETL auditing and ETL email notification. Advanced Experience with ADF (Azure Data Factory) is a mandatory skill. Experience with using REST and GRAPH API to retrieve or post data is also a must have skill for this role. Strong experience in programming languages like Java or Python. Guidance to junior Azure ETL developers. Experience in Data Lake and Data warehouse design. Collaboration with business analysts, data analyst and AI/ML team. Feature Engineering, Data Validation, Data Cleansing. Design data migration strategies, including working with software architects to ensure continuity of enterprise services. Experience in SQL Development, specifically with complex queries, tuning indexes Able to work with Scaled Agile Framework (SAFE) Drive Quality Assurance to ensure data quality is adhered as is required per requirement of the project (less than 2% of defects). Production Deployment of data pipeline and orchestration. Being able to work independently. Working in an environment where requirements are not provided to you by an analyst. Person needs to be comfortable working where a problem arises or a business case is outlined to the resource AND they are able to solution and come up with options for solution. Then put into action what they think is best while keeping the client team abreast of the latest developments. Excellent communication skills with client facing expertise is required. Qualifications: Education and Years of Experience: 5 - 9 years of overall Data Engineering experience with 5+ years of experience working with Azure services. 2+ years demonstrable experience of software development lifecycle, Lean/Agile development methodologies. 2+ years in guidance/supervisions to junior Azure ETL developers 1-2 projects consuming and leveraging REST, Graph, Groq, or SOAP APIs for receiving and providing data to downstream consumers Required and Desired Skills/Certifications: Azure Data Lake Services Azure Data Factory Synapse/AZ SQL DB SQL Azure Event Hub Azure Stream Analytics Function Apps C# Logic Apps Spark/Data Bricks Kind Regards, Devyani Kumari| Absolute IT | Sr. Technical Recruiter 116 Village Blvd Suite 200 Princeton New Jersey 08540 Absolute IT Direct: (609) 982 3380 Office: 201-228-3009 EXT 180 [email protected] www.absoluting.com Keywords: csharp artificial intelligence machine learning database information technology Arizona |
| [email protected] View all |
| Wed Nov 22 23:54:00 UTC 2023 |