| Lead GCP Data Engineer at Scottsdale, AZ at Scottsdale, Arizona, USA |
| Email: [email protected] |
| From: Praveen, Primasoft Inc. [email protected] Reply to: [email protected] Title: Lead GCP Data Engineer Location: Scottsdale, AZ *** Need Locals Or Nearby Location Only NOTE: PP Number is Mandatory For Submission Project: The Rebates team is looking for a GKE Data Engineer (Google Kubernetes Engine) to lead the initiative in helping them move financial/rebates data off their legacy mainframe database and settling the data within GKE. This person will help influence whether the team uses tools like Data Proc or Spark as well as Composer or Apache Airflow. He/she will lead Project Transform, transforming their rebate processing system from their legacy platform. The potential candidate will help engineers in rearchitecting, transforming, and designing data pipelines. Personality: Leader; Inquisitive; Communication (10/10); Share Thoughts/Opinions/Have Influence. Required skills: 10+ years of Data Engineering experience 4+ years of Lead Data Engineering experience 3+ years of experience with Apache Airflow or Composer 3+ years of experience with Data Proc or Spark 5 7 years of experience with CI/CD Experience with producing architecture solutions with Composer and Spark Experience in Large scale batch processing with cloud services. Desired skills (don't need all): Apache Spark, Map Reduce, Spark Streaming, PySpark, Hive, HDFS, Kafka, Redis, Sqoop, Oozie, IBM Data sage, Springbatch Keywords: continuous integration continuous deployment Arizona Lead GCP Data Engineer at Scottsdale, AZ [email protected] |
| [email protected] View all |
| Thu Jul 18 02:11:00 UTC 2024 |