Home

Ab Initio Developer with Spark at Bloomfield, New Jersey, USA
Email: [email protected]
From:
Naveen,
Smart IT
[email protected]
Reply to:   [email protected]

Role: Abinitio / Spark Developer

Location: Bloomfield, NJ

Long Term Contract

Job Description:

Work with business and technical leadership to understand requirements
Design to the requirements and document the designs
Ability to write product-grade performant code for data extraction, transformations and loading using Spark, Py-Spark, Ab Initio
Do data modeling as needed for the requirements
Write performant queries using Teradata SQL, Hive SQL and Spark SQL against Teradata and Hive
Implementing dev-ops pipelines to deploy code artifacts on to the designated platform/servers like AWS or Hadoop Edge Nodes
Implement Hadoop job orchestration using Shell scripting, Apache Oozie, CA7 Enterprise Scheduler and Airflow
Troubleshooting the issues, providing effective solutions and jobs monitoring in the production environment
Participate in sprint planning sessions, refinement/story-grooming sessions, daily scrums, demos and retrospectives

Skills:

Strong development experience in Spark, Py-Spark, Shell scripting, Teradata, Hive and Hadoop
Proven Experience of Ab Initio
Strong experience in writing complex and effective SQLs (using Teradata SQL, Hive SQL and Spark SQL) and Stored Procedures
Excellent work experience on Hadoop as data warehouse/Data Lake implementations
Hands-on experience with AWS services like S3, EC2, SNS, SQS, Lambda, ECS, Glue, IAM, RDS, Athena, and CloudWatch
Experience in Agile and working knowledge on DevOps tools (Git, Jenkins, Artifactory)
Unix/Linux Shell scripting (KSH) and basic administration of Unix servers
CA7 Enterprise Scheduler
Basic to moderate Terraform development experience needed
Experience in Jira and Confluence
Exercises considerable creativity, foresight, and judgment in conceiving, planning, and delivering initiatives.
Health care domain knowledge is a plus

Regards

Navaneethan

Smart IT Frame - An E- Verify Employer

220 Davidson Avenue Suite #313 Somerset NJ 08873

Direct: 7329923138      

[email protected] | www.smartitframe.com

*Email is the better way to reach me*

Keywords:
[email protected]
View all
Wed Nov 16 23:03:00 UTC 2022

To remove this job post send "job_kill 147539" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 8

Location: Bloomfield, New Jersey