| Interview Slots -- Senior Data Engineer--O`Fallon, MO (Onsite)-- Passport no. is Mandatory at ofallon, Missouri, USA |
| Email: [email protected] |
| Hi, Hope you are in fine spirits of health! My name is kunal Ahuja and I am working with Alpha Silicon. We are headquartered in Santa Clara, CA serving customers nationwide in the United States. We have the following job opening.... Job Title: Senior Data Engineer Location: O`Fallon, MO (Onsite) Duration: Long Term Contract NO OPT/CPT Please PP No. Mandatory Please share local Profiles Only Minimum 6+ years of IT experience and minimum 1+ years of hands-on experience in Databricks with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following: o Familiarity with Lakehouse Architecture with Delta Tables Delta tables, Schema Evolution, ACID compatibility, History capture etc. o Integrating Databricks with various ETL/Orchestration tools and perform required operations. o Python is Must o CI/CD Pipleine with AWS o SQL and SPARK with Date Engineering background o Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL. o Expertise in workspace and cluster configuration, performance tuning and log monitoring. o Experience with structured streaming along with streaming frameworks. o Hands on experience with Python, Scala and SQL. o Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment o Strong understanding of Data Modelling and defining conceptual logical and physical data models. o Experience in building Data Engineering solutions using AWS/Azure native stack o Experience in managing various client relationships to get consensus on solutions. -- Keywords: continuous integration continuous deployment access management information technology California Missouri |
| [email protected] View all |
| Thu Oct 19 20:01:00 UTC 2023 |