Home

Urgent requirement of ETL LEAD(REMOTE) at Remote, Remote, USA
Email: [email protected]
From:

Ayush sharma,

HMG America

[email protected]

Reply to:   [email protected]

Title:  ETL LEAD 

Location:  Florida

Duration: 1 year or longer

Mandatory Skills:  Snowflake, ETL, DataStage

Job Description:

This role involves design and development of new functionality and capabilities into the enterprise data platform as well as ongoing support / maintenance of existing data pipelines. Successful candidate will work closely with cross functional teams / stakeholders, and be responsible for ongoing and new developments on DataStage and Snowflake Cloud Data platform as well as the day-to-day operational support aspects. The candidate should also have strong communication skills and be able to collaborate with technical and non-technical partners and senior management stakeholders.
10+ year of IT Industry experience in Data Engineering role
Proficiency in Snowflake Cloud Data Platform and familiarity with AWS /Azure cloud platform
Strong leadership quality and able to handle a team of 5 - 10 resources
Ability to provide technical guidance to data engineering team for data pipeline design and enhancements
Strong experience in ETL with Data migration, data consolidation
Hands-on experience in ETL data loading around event and messaging patterns, streaming data, Kafka , API
Understanding of fundamentals of DevOps CI/CD, Git and Git workflows and SAAS-based Git tools like GitHub, GitLab, Bitbucket
Experience of working in agile application development environment
Ability to proactively prioritize tasks in consultation with business stakeholders, Product Owners, Product Managers
Design, Build, Deploy and Support DataStage ETL jobs to extract data from disparate source systems, transform, and load data into EDW for data mart consumption, self-service analytics, and data visualization tools.
Ensure data quality, efficient processing, and timely delivery of accurate and trusted data.
The ability to design, implement and optimize large-scale data and analytics solutions on Snowflake Cloud Data Warehouse is essential.
Establish ongoing end-to-end monitoring for the data pipelines.
Strong understanding of full CI/CD lifecycle.
Convert business requirements to technical solution
Ensure adherence to architectural guidelines, strategic business needs
Technical feasibility analysis, recommendations and effort estimation
Provide operational instructions for dev, QA, and production code deployments while adhering to internal Change Management processes.
Performance optimization
QA support
Automation

Must Haves:
Total of 5+ years in data engineering role with 2+ years of recent experience with  Snowflake.
Extensive experience in design, development and support of complex ETL solutions
Ability to design and implement highly performant data ingestion pipelines from multiple sources using DataStage, SnowPipe, SNOWSQL.
In-depth knowledge of SnowPipe, SNOWSQL, stored procedures
Experience in DataStage and Snowflake performance optimization
Hands-on development experience with Snowflake data platform features including Snowpipes, SnowSQL,tasks, stored procedures, streams, resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, cloning, time travel, data sharing and respective use cases.
Advanced proficiency in writing complex SQL statements and manipulating large structured and semi-structured datasets.
Build processes supporting data transformation, data structures, metadata, dependency and workload management.
Demonstrable experience designing and implementing modern data warehouse/data lake solutions with an understanding of best practices.

Good to Have:
Valid professional certification
Experience in Python and BigData Cloud platform
Expertise in Unix & Shell Scripting
Excellent verbal and written communication and interpersonal skills
Confidence and agility in challenging times
Ability to work collaboratively with cross-functional teams in a fast-paced, team environment.

Keywords: continuous integration continuous deployment quality analyst information technology
[email protected]
View all
Fri Oct 27 04:00:00 UTC 2023

To remove this job post send "job_kill 797237" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 0

Location: ,