| Data Bricks - Data Engineer - O'Fallon, Missouri (Day 1 onsite) at ofallon, Missouri, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=633031&uid= From: Sudheer Vangaala, United software group [email protected] Reply to: [email protected] Hi This is Sudheer from United Software Group Inc. Hope youre doing great today. I have an opening for the below requirement. If youre interested please let me know. Position: Data Bricks - Data Engineer Location: O'Fallon, Missouri (Day 1 onsite) Duration: 12 Months Contract W2 Only Job Description : Minimum 6+ years of IT experience with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following: o Familiarity with Lakehouse Architecture with Delta Tables Delta tables, Schema Evolution, ACID compatibility, History capture etc. o Integrating Databricks with various ETL/Orchestration tools and perform required operations. o Python is Must o CI/CD Pipleine with AWS o SQL and SPARK with Date Engineering background o Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL. o Expertise in workspace and cluster configuration, performance tuning and log monitoring. o Experience with structured streaming along with streaming frameworks. o Hands on experience with Python, Scala and SQL. o Create and maintain imal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment o Strong understanding of Data Modelling and defining conceptual logical and physical data models. o Experience in building Data Engineering solutions using AWS/Azure native stack o Experience in managing various client relationships to get consensus on solutions. o Nice to have AI/ML skill and any architect level certification from Databricks Keywords: continuous integration continuous deployment artificial intelligence machine learning information technology wtwo http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=633031&uid= |
| [email protected] View All |
| 07:28 PM 13-Sep-23 |