Urgnet need of Lead Data Engineer || REMOTE at Remote, Remote, USA |
Email: [email protected] |
From: Pradip Ojha, Sourceinfotech Inc [email protected] Reply to: [email protected] Role Title: Lead Data Engineer (if you have someone strong with no lead experience but who is sr and wants to be a lead and is sharp they are open to it if they have built pipelines and taken them all the way to production as well) REMOTE- 100% REMOTE (CST Hours) - EST or CST Remote (EST Hours - Occasional Travel to Charlotte/Baltimore as needed) Contract Duration or Perm: 6-12 month contract GC/USC Only ! Must Haves: 5-7+ years of experience Has this person taken data pipelines to production If yes, open on years of experience Production Experience is the most important thing AWS Experience Data Pipelines: AWS Glue, Cloudwatch, Strong Python (8/10 or better) Airflow (comparable scheduler OK) AWS Lambda Data Warehousing Experience AWS Specific Snowflake/S3 (avoid MS Azure) Database technologies (they use Snowflake and DynamoDB) Python, SQL for data mining Bachelors: No Preferred Skills: Snowflake experience Production experience Financial services background MarTech stack Job Description: Working knowledge of key digital marketing capabilities customer identity/context, data management, marketing analytics, marketing automation and orchestration, decision engines/offer engines/personalization, multi-channel activation, customer engagement. Advanced knowledge one of language: Snowflake,Java, Scala, Python, C# Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake Proficient with Data mining/programming tools (e.g. SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum) Data visualization (e.g. Tableau, Looker, MicroStrategy) Comfortable learning about and deploying new technologies and tools. Preferred AWS certification Spark Streaming Kafka Streaming / Kafka Connect ELK Stack Cassandra / MongoDB CI/CD: Jenkins, GitLab, Jira, Confluence other related tools EXTRA NOTES Specifically Working knowledge of key digital marketing capabilities customer identity/context, data management, marketing analytics, marketing automation and orchestration, decision engines/offer engines/personalization, multi-channel activation, customer engagement. Advanced knowledge one of language: Snowflake,Java, Scala, Python, C# Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake Proficient with Data mining/programming tools (e.g. SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum) Data visualization (e.g. Tableau, Looker, MicroStrategy) Comfortable learning about and deploying new technologies and tools. Preferred AWS certification Spark Streaming Kafka Streaming / Kafka Connect ELK Stack Cassandra / MongoDB CI/CD: Jenkins, GitLab, Jira, Confluence other related tools -Spark, Kafka, Kafka, data pipelines, apache airflow data lake, snowflake, API gateway, python, scala, java, & mo (glue, lambda, fargate, kinesis, s3 buckets, etc, api gateway Thanks & Regards Pradeep Source Infotech Inc P.O Box 577, EDISON, NJ 08818-0577 EMAIL: [email protected] Phone: 609-956-0017 | Fax: 732-909-2282 | Hangout: Pradipk906 || Jai Mata Di || Keywords: csharp continuous integration continuous deployment sthree rlang information technology green card microsoft Missouri New Jersey |
[email protected] View all |
Wed Sep 13 00:45:00 UTC 2023 |