| Sr. Data Architect Azure & Databricks || New York / Weehawken, NJ (Day 1 onsite ) at York, New York, USA |
| Email: [email protected] |
| Title - Sr. Data Architect Azure & Databricks Location - New York / Weehawken, NJ (Day 1 onsite ) Must have Skills - Databricks, Azure Datalake, PySpark, Scala, Java. Experience 12+ years Job Description : Minimum 12+ years of IT experience and at least 5+ years in cloud native data engineering solution design/architecture and development. Strong hands-on expertise in building Data engineering solutions using Apache Spark and Scala. Deep expertise in Performance tuning and optimization of Spark/Scala programs. Ability to design and build data engineering tasks using Data bricks framework. Hands on experience working with Azure Cloud services like Azure Data Factory, Azure Data Lake Storage, Azure Even hub, Azure SQL, Azure Analytical services, Azure Cosmos DB, Should be able to demonstrate expertise in designing and building efficient and scalable data engineering solutions using Massively Parallel Processing (MPP) architecture. Micro-batch streaming and continuous streaming process in Databricks for high latency, low latency and ultra-low latency of data accordingly by using inbuilt Apache spark modules Data Ingestion to one or more Azure Services - (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL Experience building and optimizing big data data pipelines, architectures and data sets. Experience in writing HQL queries in Hive Data warehouse and performance tuning of HIVE scripts Well versed with Relational and Dimensional Modeling techniques like Star, Snowflake Schema, OLTP, OLAP, Normalization, Fact and Dimensional Tables Proficient in creating Technical Design Documents (TDD). Familiar with DevOps principles and experience in CD/CI implementations using Azure native services. Very good customer relationship and stakeholder management skills Excellent communication and presentation skills. Thanks & Regards, https://www.excelonsolutions.com Adil Musawwir Technical Recruiter Email: adil.musawwir @excelonsolutions.com Helping Every day To Bring Out Your Best Disclaimer: The contents of this e-mail and any attachment(s) are confidential and intended for the named recipient(s) only. E-mail transmission is not guaranteed to be secure or error-free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or may contain viruses in transmission. The e-mail and its contents (with or without referred errors) shall therefore not attach any liability on the originator or Excelon Solutions LLC or its affiliates. Views or opinions, if any, presented in this email are solely those of the author and may not necessarily reflect the views or opinions of Excelon Solutions LLC or its affiliates. Any form of reproduction, dissemination, copying, disclosure, modification, distribution and / or publication of this message without the prior written consent of authorized representative of Excelon Solutions LLC is strictly prohibited. This communication is intended only for the use of the addressee(s) and contains information that is PRIVILEGED AND CONFIDENTIAL. Unauthorized reading, dissemination, distribution, or copying of this communication is prohibited. -- Keywords: continuous integration continuous deployment database information technology New Jersey |
| [email protected] View all |
| Fri Oct 20 19:56:00 UTC 2023 |