Job Details

Home

High Priority Position: Data Engineer with Databricks, Delta Lake, ETL, Spark, Dataiku, Data Migration, SAP (e.g., SAP HANA, SAP BW), SharePoint, Python, Pyspark Exp with Databricks Certification || Remote at Delta, Utah, USA

Email: [email protected]

Dear Professional,

Hope you are doing great today...

This is BABU, BDM FROM PANTAR SOLUTIONS INC, we are an Information Technology and Business Consulting firm specializing in Project-based Solutions and Professional Staffing Services. Please have a look at below position which is with our Client and let me know your interest ASAP. I would really appreciate if you could send me your MOST RECENT UPDATED RESUME:

Data Engineer with Databricks, Delta Lake, ETL, Spark, Dataiku, Data Migration, SAP (e.g., SAP HANA, SAP BW), SharePoint, Python, Pyspark Exp with Databricks Certification.

Location: Remote

Number of Positions : 2-3

Need Databricks Certification

Consultant's LinkedIn profile must have been created before 2018

Need 8-10+ yrs of IT Exp. Profiles || Need Passport number, I94, Travel History documents during submission for H1/GC/GC EAD

Key Responsibilities:

Data Migration:

                              Lead the end-to-end migration of data from SAP and SharePoint to Databricks Delta Lake.

                              Develop and implement ETL (Extract, Transform, Load) pipelines to move large volumes of data into Databricks.

                              Ensure data quality, accuracy, and integrity during the migration process within the data policy framework and clients enterprise architecture.

                              Design and manage robust data models and architectures within Databricks Delta Lake.

Integration:

                              Work closely with data engineers and data architects to integrate Databricks Delta Lake data into Dataiku for downstream data processing and analytics.

                              Build scalable solutions that facilitate seamless data integration across the enterprise.

                              Collaborate with cross-functional teams to develop integration strategies that align with business goals.

Optimization and Performance:

                              Optimize Databricks clusters for performance and scalability.

                              Perform regular data validation and error checking to ensure the successful migration and integration of data.

                              Monitor system performance and troubleshoot any issues that arise during migration and integration phases.

Collaboration:

                              Work with SAP and SharePoint subject matter experts to understand source data structures and develop migration strategies.

                              Collaborate with data architects, developers, and business stakeholders to ensure that solutions meet business and technical requirements.

                              Provide technical guidance and mentorship to junior team members.

Key Qualifications:

Having Databricks Certification is a MUST.

    Technical Expertise:

                              4+ years of experience working with Databricks and Delta Lake.

                              Strong experience with data migration processes, particularly from SAP and SharePoint.

                              Expertise in building and managing ETL pipelines.

                              Proficiency in Spark for data processing in Databricks.

Familiarity with Dataiku or similar data platforms is a strong advantage.

               SAP and SharePoint Knowledge:

                              Experience in extracting data from SAP (e.g., SAP HANA, SAP BW) and SharePoint.

                              Strong understanding of SAP and SharePoint data models and structures.

               Programming and Data Management:

                              Proficiency in Python, SQL, and PySpark for data manipulation and transformation.

                              Familiarity with cloud-based data platforms (e.g., AWS, Azure, or GCP) and working within cloud environments.

                              Understanding of data warehousing concepts and experience with large-scale data migration projects.

               Problem Solving & Communication:

                              Excellent problem-solving skills and the ability to troubleshoot complex data migration and integration issues.

                              Strong communication skills to collaborate with both technical and non-technical stakeholders.

Preferred Qualifications:

              Experience with CI/CD pipelines and automation in Databricks environments.

                              Knowledge of Delta Live Tables for real-time data processing in Databricks.

                              Familiarity with data governance and data security best practices.

PLEASE NOTE:

If for any reason this does not interest you or you felt uncomfortable by any part of this email, I sincerely apologize. Please consider this E-mail as a request for referrals and feel free in forward this email to anyone whom you might find a fit.

Thanks & Regards,

Babu

Pantar Solutions Inc

1908 Cox Rd, Weddington, NC 28104

Email:
babu (dot) s (at)
pantarsolutions (dot) com

Keywords: continuous integration continuous deployment information technology business works green card North Carolina
High Priority Position: Data Engineer with Databricks, Delta Lake, ETL, Spark, Dataiku, Data Migration, SAP (e.g., SAP HANA, SAP BW), SharePoint, Python, Pyspark Exp with Databricks Certification || Remote
[email protected]

[email protected]
View all

Mon Sep 16 21:25:00 UTC 2024

To remove this job post send "job_kill 1752874" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.

Your reply to [email protected] -

To

Subject
Message -

babu.pantarsol@gmail.com wrote:
Dear Professional,

Hope you are doing great today...

This is BABU, BDM FROM PANTAR SOLUTIONS INC, we are an Information Technology and Business Consulting firm specializing in Project-based Solutions and Professional Staffing Services. Please have a look at below position which is with our Client and let me know your interest ASAP. I would really appreciate if you could send me your MOST RECENT UPDATED RESUME:

Data Engineer with Databricks, Delta Lake, ETL, Spark, Dataiku, Data Migration, SAP (e.g., SAP HANA, SAP BW), SharePoint, Python, Pyspark Exp with Databricks Certification.

Location: Remote

Number of Positions  : 2-3

Need Databricks Certification

Consultant's LinkedIn profile must have been created before 2018

Need 8-10+ yrs of IT Exp. Profiles || Need Passport number, I94, Travel History documents during submission for H1/GC/GC EAD

Key Responsibilities:

Data Migration:

Lead the end-to-end migration of data from SAP and SharePoint to Databricks Delta Lake.

Develop and implement ETL (Extract, Transform, Load) pipelines to move large volumes of data into Databricks.

Ensure data quality, accuracy, and integrity during the migration process within the data policy framework and clients enterprise architecture.

Design and manage robust data models and architectures within Databricks Delta Lake.

Integration:

Work closely with data engineers and data architects to integrate Databricks Delta Lake data into Dataiku for downstream data processing and analytics.

Build scalable solutions that facilitate seamless data integration across the enterprise.

Collaborate with cross-functional teams to develop integration strategies that align with business goals.

Optimization and Performance:

Optimize Databricks clusters for performance and scalability.

Perform regular data validation and error checking to ensure the successful migration and integration of data.

Monitor system performance and troubleshoot any issues that arise during migration and integration phases.

Collaboration:

Work with SAP and SharePoint subject matter experts to understand source data structures and develop migration strategies.

Collaborate with data architects, developers, and business stakeholders to ensure that solutions meet business and technical requirements.

Provide technical guidance and mentorship to junior team members.

Key Qualifications:

Having Databricks Certification is a MUST.

Technical Expertise:

4+ years of experience working with Databricks and Delta Lake.

Strong experience with data migration processes, particularly from SAP and SharePoint.

Expertise in building and managing ETL pipelines.

Proficiency in Spark for data processing in Databricks.

Familiarity with Dataiku or similar data platforms is a strong advantage.

SAP and SharePoint Knowledge:

Experience in extracting data from SAP (e.g., SAP HANA, SAP BW) and SharePoint.

Strong understanding of SAP and SharePoint data models and structures.

Programming and Data Management:

Proficiency in Python, SQL, and PySpark for data manipulation and transformation.

Familiarity with cloud-based data platforms (e.g., AWS, Azure, or GCP) and working within cloud environments.

Understanding of data warehousing concepts and experience with large-scale data migration projects.

Problem Solving & Communication:

Excellent problem-solving skills and the ability to troubleshoot complex data migration and integration issues.

Strong communication skills to collaborate with both technical and non-technical stakeholders.

Preferred Qualifications:

Experience with CI/CD pipelines and automation in Databricks environments.

Knowledge of Delta Live Tables for real-time data processing in Databricks.

Familiarity with data governance and data security best practices.

PLEASE NOTE:

If for any reason this does not interest you or you felt uncomfortable by any part of this email, I sincerely apologize. Please consider this E-mail as a request for referrals and feel free in forward this email to anyone whom you might find a fit.

Thanks & Regards,

Babu

Pantar Solutions Inc

1908 Cox Rd, Weddington, NC  28104

Email: 
babu (dot) s (at) 
pantarsolutions (dot) com

Keywords: continuous integration continuous deployment information technology business works green card North Carolina 
High Priority Position: Data Engineer with Databricks, Delta Lake, ETL, Spark, Dataiku, Data Migration, SAP (e.g., SAP HANA, SAP BW), SharePoint, Python, Pyspark Exp with Databricks Certification || Remote
babu.pantarsol@gmail.com

Your email id:

Captcha Image:

Captcha Code:

Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 0

Location: ,