| Data Engineer with Databricks Experience at Boca Raton, Florida, USA |
| Email: [email protected] |
| From: Lovely Singh, Tek Inspiration [email protected] Reply to: [email protected] Hi, Hope you are doing great!!! Please share suitable profile Data Engineer with Databricks Experience Duration: 6+ month C2H Location: Boca Raton, FL Role: Remote but must be local to Boca Raton only. MOI: Video Visa: GC/USC/H4 EAD Must-Have LinkedIn Job Description: Position Overview: We are seeking a talented and experienced Data Engineer with a strong background in Databricks to join our dynamic and innovative team. As a Data Engineer, you will play a pivotal role in designing, building, and maintaining the data architecture and infrastructure necessary for our data-driven initiatives. Your expertise in Databricks will be crucial in optimizing our data pipelines, ensuring data accuracy, and enabling advanced analytics and machine learning efforts. Key Responsibilities: 1. Data Pipeline Development: Design, develop, and maintain efficient and scalable data pipelines using Databricks. Collaborate with cross-functional teams to understand data requirements and implement solutions to ingest, transform, and load data from various sources into our data lake or data warehouse. 2. Databricks Expertise: Utilize your in-depth knowledge of Databricks to optimize performance, troubleshoot issues, and fine-tune Spark jobs. Implement best practices in Databricks workspace organization, job scheduling, and resource management. 3. Data Modeling and Transformation: Work closely with data analysts, data scientists, and business stakeholders to understand data modeling requirements and translate them into efficient ETL processes. Apply data transformation techniques to ensure data consistency, quality, and accuracy. 4. Data Quality and Governance: Implement data quality checks, monitoring, and validation procedures to ensure the integrity of the data flowing through pipelines. Contribute to data governance initiatives by adhering to data standards and best practices. 5. Performance Optimization: Identify and address performance bottlenecks in data pipelines and optimize data processing workflows. Continuously monitor and enhance the performance of Spark jobs and Databricks clusters. 6. Documentation and Collaboration: Create and maintain documentation for data pipelines, workflows, and Databricks-related processes. Collaborate effectively with team members, providing technical expertise and guidance on Databricks-related matters. REGARD Lovely Singh Keywords: green card Florida |
| [email protected] View all |
| Tue Oct 17 00:29:00 UTC 2023 |