Home

Urgent Need || Data Engineers || Scottsdale AZ (day 1 onsite) || 10+yr at Scottsdale, Arizona, USA
Email: [email protected]
From:

Maan,

Samsonsoft

[email protected]

Reply to: [email protected]

Hello ,

Hope you are doing well!

This is Maan from Samson Software Solution Inc. We provide high-quality IT resources to meet talent needs through Staff Augmentation and Permanent Placement Services.

I came across your resume on one of the job boards and you seem to be a fit for the position we have. Please review the job and share the below details along with your profile, if you are interested.

Role: Data Engineers

Location: Scottsdale AZ (day 1 onsite)

Job Description:

Must have skill set: Java, S3, Glue, Scala, AWS, SQL, and Python

8-10 years of IT experience focusing on enterprise data architecture and management.

Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data Modelling

Experience with Databricks & on Prem , Structured Streaming, Delta Lake concepts, and Delta Live Tables required

Experience with Spark scala

Data Lake concepts such as time travel and schema evolution and optimization

Structured Streaming and Delta Live Tables with Databricks a bonus

Experience leading and architecting enterprise-wide initiatives specifically system integration, data migration, transformation, data warehouse build, data mart build, and data lakes implementation / support

Advanced level understanding of streaming data pipelines and how they differ from batch systems

Formalize concepts of how to handle late data, defining windows, and data freshness

Advanced understanding of ETL and ELT and ETL/ELT tools such as Data Migration Service etc

Understanding of concepts and implementation strategies for different incremental data loads such as tumbling window, sliding window, high watermark, etc.

Familiarity and/or expertise with Great Expectations or other data quality/data validation frameworks a bonus

Familiarity with concepts such as late data, defining windows, and how window definitions impact data freshness

Advanced level SQL experience (Joins, Aggregation, Windowing functions, Common Table Expressions, RDBMS schema design performance optimization)

Indexing and partitioning strategy experience

Debug, troubleshoot, design and implement solutions to complex technical issues

Experience with large-scale, high-performance enterprise big data application deployment and solution

Architecture experience in AWS environment a bonus

Familiarity working with Lambda specifically with how to push and pull data, how to use AWS tools to view data for processing massive data at scale a bonus

Experience with Gitlabs and CloudWatch and ability to write and maintain gitlabs for supporting CI/CD pipelines

Experience working with AWS Lambdas for configuration and optimization and experience with S3

Familiarity with Schema Registry, message formats such as Avro, ORC, etc.

Ability to thrive in a team-based environment

Experience briefing the benefits and constraints of technology solutions to technology partners, stakeholders, team members, and senior level of management

Thanks & Regards,

Maan Singh Choudhary | US IT Recruiter

LinkedIn : https://www.linkedin.com/in/maan-singh-choudhary-714023182/

Samson Software Solutions Inc.

Address:1 Rossmoor Drive Suite 140, Monroe Twp, NJ- 08831

Desk: +1-609-928-8941

Email: [email protected] | www.Samsonsoft.com

Keywords: continuous integration continuous deployment sthree information technology Arizona New Jersey
[email protected]
View all
Wed Mar 13 02:32:00 UTC 2024

To remove this job post send "job_kill 1210675" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 44

Location: Scottsdale, Arizona