Azure Data Engineer Location-Chicago IL at Chicago, Illinois, USA |
Email: [email protected] |
Role name:Engineer Role Description:Work in Agile development projects for batch and real time data ingestion, transformationWork closely with product owners, understand requirements, lead offshore team on Development and QE of data pipelinesWork with upstream/downstream teams to resolve any issues/blockersWork with System Integration/Performance engineering team for integration/performance testing of data pipelinesCoordinate with DevOps/RunOps teams for deployment in higher environments Competencies:Digital : Apache Spark, Digital : Scala, Digital : Databricks Experience (Years):6-8 Essential Skills: Minimum 4-6 years of experience in Data Warehousing and Analytics Minimum 3-4 years of experience on Spark with Scala / Azure Databricks Hands on experience of building data pipelines using Apache Spark (Azure Databricks), Scala Hands on experience working on Databricks batch. Hands on experience in Azure Data Factory. Hands on experience in designing and delivering solutions using the Azure Data Analytics platform including Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Experience working on Delta Lakes. Experience working in a Dev/Ops environment with tools such as Azure DevOps Should be able to work independently on assigned projects with offshore team. Desirable Skills: Knowledge of Talend Tool. Exposure to Azure PaaS services is highly desirable. Problem-solving and good analytical skills Communication, teamwork and negotiation skills Country:United States Branch | City | Location:TCS - Chicago(Naperville), IL DEERFIELD -- Tauheed Saleem | Talent Acquisition Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd 2838 E. Long Lake Road Suite 210, Troy, MI 48085 [email protected] LinkedIn- linkedin.com/in/tauheed-saleem-92ab546a/ Disclaimer This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to which they are addressed. If you have received this email in error please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Please notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mail from your system. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. -- Keywords: information technology Illinois Michigan |
[email protected] View all |
Tue Feb 27 02:24:00 UTC 2024 |