Home

Urgnet need of Lead Data Engineer || REMOTE at Remote, Remote, USA
Email: [email protected]
From:

Pradip Ojha,

Sourceinfotech Inc

[email protected]

Reply to:   [email protected]

Role Title: Lead Data Engineer (if you have someone strong with no lead experience but who is sr and wants to be a lead and is sharp they are open to it if they have built pipelines and taken them all the way to production as well)

REMOTE- 100% REMOTE (CST Hours) - EST or CST

Remote (EST Hours - Occasional Travel to Charlotte/Baltimore as needed) 

Contract Duration or Perm:

6-12 month contract 

GC/USC Only !

Must Haves:

5-7+ years of experience

Has this person taken data pipelines to production If yes, open on years of experience 

Production Experience is the most important thing

AWS Experience

Data Pipelines: AWS Glue, Cloudwatch, 

Strong Python (8/10 or better) 

Airflow (comparable scheduler OK) 

AWS Lambda 

Data Warehousing Experience AWS Specific Snowflake/S3 (avoid MS Azure) 

Database technologies (they use Snowflake and DynamoDB) 

Python, SQL for data mining 

Bachelors: No

Preferred Skills:

Snowflake experience

Production experience

Financial services background

MarTech stack

Job Description:

Working knowledge of key digital marketing capabilities customer identity/context, data management, marketing analytics, marketing automation and orchestration, decision engines/offer engines/personalization, multi-channel activation, customer engagement.  

        Advanced knowledge one of language: Snowflake,Java, Scala, Python, C#

        Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake

        Proficient with

        Data mining/programming tools (e.g. SAS, SQL, R, Python)

        Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

        Data visualization (e.g. Tableau, Looker, MicroStrategy)

        Comfortable learning about and deploying new technologies and tools.

        Preferred

        AWS certification

        Spark Streaming

        Kafka Streaming / Kafka Connect

        ELK Stack

        Cassandra / MongoDB

        CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

EXTRA NOTES

Specifically

  Working knowledge of key digital marketing capabilities customer identity/context, data management, marketing analytics, marketing automation and orchestration, decision engines/offer engines/personalization, multi-channel activation, customer engagement.  

  Advanced knowledge one of language: Snowflake,Java, Scala, Python, C#

Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake

        Proficient with

Data mining/programming tools (e.g. SAS, SQL, R, Python)

  Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)

Data visualization (e.g. Tableau, Looker, MicroStrategy)

        Comfortable learning about and deploying new technologies and tools.

        Preferred

  AWS certification

  Spark Streaming

  Kafka Streaming / Kafka Connect

  ELK Stack

Cassandra / MongoDB

CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

-Spark, Kafka,

Kafka, data pipelines, apache airflow

 data lake, snowflake, API gateway, python, scala, java, & mo

(glue, lambda, fargate, kinesis, s3 buckets, etc, api gateway

Thanks & Regards

Pradeep

Source Infotech Inc

P.O Box 577, EDISON, NJ 08818-0577

EMAIL:

[email protected]

Phone: 609-956-0017  | Fax: 732-909-2282 | Hangout: Pradipk906

|| Jai Mata Di ||

Keywords: csharp continuous integration continuous deployment sthree rlang information technology green card microsoft Missouri New Jersey
[email protected]
View all
Wed Sep 13 00:45:00 UTC 2023

To remove this job post send "job_kill 630550" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 0

Location: ,