| Databricks Engineer no h1b , opt ,cpt at Remote, Remote, USA |
| Email: [email protected] |
| From: Chandan Rai, Vaaridatech [email protected] Reply to: [email protected] Job Title: Databricks Engineer (NO H1B , OPT ,CPT) Location: Triangle Region of North Carolina (Local candidates only) Onsite Requirement: The candidate must come onsite on the first day to collect equipment. Additionally, the role may require up to 1-2 days per month in a Triangle area office for meetings.Skills & Experience: Interpersonal & Communication Skills: Excellent interpersonal, written, and communication skills. Experience: 5 years Required Databricks Notebook Coding: Ability to write clean and easy-to-follow Databricks notebook code. Experience: 2 years Required Data Engineering & Architecture: Deep knowledge of data engineering best practices, data warehouses, data lakes, and Delta Lake architecture. Experience: 2 years Required Spark & Databricks SQL/PySpark: Strong proficiency in Spark and Databricks SQL/PySpark. Experience: 2 years Required Azure Databricks & Cloud Providers: Technical experience with Azure Databricks and cloud platforms (AWS, Google Cloud, or Azure). Experience: 2 years Required OLTP & OLAP Systems, Apache Spark, Streaming Products: In-depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming technologies like Azure Service Bus. Experience: 2 years Required Databricks Delta Live Tables: Practical experience with Databricks Delta Live Tables. Experience: 2 years Required Object-Oriented Programming: Knowledge of object-oriented languages such as C#, Java, or Python. Experience: 7 years DesiredJob Description: The NCDIT-Transportation Web Systems Team seeks an Azure Databricks Engineer to plan, design, and develop ETL pipelines and data solutions using Azure Databricks. The successful candidate will collaborate with business users and stakeholders to create data products, ensuring that data pipelines are efficient, resilient, and secure. Key Responsibilities: Research and develop repeatable ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing. Collaborate with business users to create data products that meet domain-specific needs. Work with database administrators (DBAs) to ingest data from both cloud-based and on-premises transactional databases. Contribute to the development of NC DITs Data Architecture by: Ensuring sensitive data remains secure. Streamlining the creation of data products for use by data analysts and scientists. Maintaining comprehensive documentation of data engineering processes. Ensuring data quality through testing and validation. Sharing insights and experiences with other engineers and stakeholders Keywords: csharp North Carolina Databricks Engineer no h1b , opt ,cpt [email protected] |
| [email protected] View all |
| Wed Oct 23 23:05:00 UTC 2024 |