Data Engineer- Apache Beam Apache Flink at Apache, Oklahoma, USA |
Email: [email protected] |
From: vaishnavi, Xforia [email protected] Reply to: [email protected] Job Description : (GCP , APACHE FLINK AND APACHE BEAM EXPERIENCE IS MANDATORY) Hands on exp in constructing Realtime Event data consumption and transformation pipelines over the GCP that consumes data from Pubsub Hands on exp in Streaming Data Flow jobs creation over GCP using Custom Templates, Able to create Java based Data pipeline creation using Apache Beam (Python knowledge required) Constructing the Apache Beam based templates that help to deploy over the GCP Data Flow Knowing the Apache Flink is added advantage. Capturing metrics to measure the Pipelines throughput and peak capacity Able to create the CI/CD pipelines to deploy over the GCP Composer(Airflow) Knowledge about GCS, BigQuery, Cloud Functions Keywords: continuous integration continuous deployment |
[email protected] View all |
Sat Oct 07 02:51:00 UTC 2023 |