| Data Bricks - Data Engineer || O'Fallon, Missouri at Remote, Remote, USA |
| Email: [email protected] |
| Greetings from Tanisha Systems!! Hope you are doing great today !! My name is Muskan & I am glad to write you an email for the below-mentioned Job that I have with one of our clients would appreciate it if you could let me know about your interest in pursuing it or if you know anyone who might be a good fit. Role: Data Bricks - Data Engineer Minimum 6+ years of IT experience with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following: o Familiarity with Lakehouse Architecture with Delta Tables Delta tables, Schema Evolution, ACID compatibility, History capture etc. o Integrating Databricks with various ETL/Orchestration tools and perform required operations. o Python is Must o CI/CD Pipleine with AWS o SQL and SPARK with Date Engineering background o Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL. o Expertise in workspace and cluster configuration, performance tuning and log monitoring. o Experience with structured streaming along with streaming frameworks. o Hands on experience with Python, Scala and SQL. o Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment o Strong understanding of Data Modelling and defining conceptual logical and physical data models. o Experience in building Data Engineering solutions using AWS/Azure native stack o Experience in managing various client relationships to get consensus on solutions. o Nice to have AI/ML skill and any architect level certification from Databricks Thanks, and Regards, Muskan Shukla Sr.Technical Recruiter Desk: 212-729-6543 Ext 635 Tanisha Systems Inc. 99 Wood Ave South, Suite # 308, Iselin, NJ 08830 Email: [email protected] Muskan Shukla | LinkedIn -- Keywords: continuous integration continuous deployment artificial intelligence machine learning access management information technology New Jersey |
| [email protected] View all |
| Wed Sep 13 19:06:00 UTC 2023 |