| Urgent Opening for Lead GCP Data Engineer in Short Hills, NJ (Remote) at Hills, Minnesota, USA |
| Email: [email protected] |
| From: Bharani, Vy Systems [email protected] Reply to: [email protected] Position: Lead GCP Data Engineer Location: Short Hills, NJ (Remote) Look for EST Time Zone Profiles Duration: Contract Job Description: Proven experience (9+ years) as a Data Engineer . Extensive hands-on experience with GCP services including DataProc and Pub/Sub. Proficiency in programming languages such as Java (must), Pyspark and Scala. Experience working with Hadoop eco system including YARN scheduler and Apache livy. Good to have experience in AWS EMR, Kinesis and migration project. GCP certification(s) Required. Develop, implement, and optimize real-time data processing workflows using GCP services such as dataproc and Pub/Sub. Provide technical leadership and mentorship to junior data engineers, fostering skill development and best practices. Diagnose and resolve issues related to batch and stream job processing. Strong communication skills to effectively interact with both technical and non-technical stakeholders. Create and maintain comprehensive documentation for data processing workflows, ensuring easy knowledge transfer and compliance with data governance standards. Keywords: New Jersey |
| [email protected] View all |
| Tue Dec 19 20:08:00 UTC 2023 |