| Urgent Req:GKE Data Engineer || Remote || at Remote, Remote, USA |
| Email: [email protected] |
| From: Rajesh Kumar, Pivotal Technologies, Inc [email protected] Reply to: [email protected] Role: GKE Data Engineer (Google Kubernetes Engine) Skill Level: SME / Senior Location: Remote Duration: 6+ Months No H1B Position Title * GKE Data Engineer - SME Position Responsibilities Project: The Rebates team is looking for a GKE Data Engineer (Google Kubernetes Engine) to lead the initiative in helping them move financial/rebates data off their legacy mainframe database and settling the data within GKE. This person will help influence whether the team uses tools like Data Proc or Spark as well as Composer or Apache Airflow. He/she will lead Project Transform, transforming their rebate processing system from their legacy platform. The potential candidate will help engineers in rearchitecting, transforming, and designing data pipelines. Personality: Leader; Inquisitive; Communication (10/10); Share Thoughts/Opinions/Have Influence. Required skills: 5 -- 7 years of Data Engineering experience 3+ years of Lead Data Engineering experience 3+ years of experience with Apache Airflow or Composer 3+ years of experience with Data Proc or Spark 5 7 years of experience with CI/CD Experience with producing architecture solutions with Composer and Spark Experience in Large scale batch processing with cloud services. Desired skills (don't need all): Apache Spark, Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data sage, Springbatch Keywords: continuous integration continuous deployment Urgent Req:GKE Data Engineer || Remote || [email protected] |
| [email protected] View all |
| Wed Jul 17 02:50:00 UTC 2024 |