Requirement for GCP (Google Cloud Platform) Data Engineer with Big Data, Remote (with ability to go into office in Dallas, Texas) at Dallas, Texas, USA |
Email: [email protected] |
From: SAPNA, ITECS [email protected] Reply to: [email protected] Position: GCP (Google Cloud Platform) Data Engineer with Big Data Location: Remote (with ability to go into office in Dallas, Texas) Local Dallas, TX candidates preferred. Key Skills: GCP (Google Cloud Platform) DATA ENGINEER , expert with Cloud Fusion , Big Query , Data Proc , Data Pipelines ,ETL , BigQuery, GCS, Cloud Composer, Dataproc, Dataflow, Dataprep, Cloud Pub/Sub, Metadata DB, Data Studio, Datalab, other Minimum Certifications needed: Google cloud Data Engineer . Design Data Pipelines: work with other Data Engineering personnel on an overall design for flowing data from various internal and external sources into the GCP Build Data Pipelines: leverage standard toolset and develop ETL/ELT code to move data from various internal and external sources into the GCP Support Data Quality Program: work with Data QA Engineer to identify automated QA checks and associated monitoring & alerting to ensure GCP maintains consistently high quality data Support Operations: triage alerts channeled to you and remediate as necessary Technical Documentation: leverage templates provided and create clear, simple and comprehensive documentation for your development Key contributor to defining, implementing and supporting: Data Services Data Dictionary Tool Standards Best Practices Data Lineage User Training Qualifications: Strong ELT/ ETL designer/developer Strong SQL Strong Python Structured & unstructured data expertise Cloud environment development & operations experience (GCP) Preference for candidates experienced with: Google Cloud Platform (GCP) and associated services; e.g. BigQuery, GCS, Cloud Composer, Dataproc, Dataflow, Dataprep, Cloud Pub/Sub, Metadata DB, Data Studio, Datalab, other Other important tools: Apache Airflow (scheduler), Bitbucket and git (version control), Stackdriver (ops monitoring), Opsgenie (alert notification), Docker Real-time data replication/streaming tools Data Modeling Excellent verbal and written communications Strong team player Keywords: quality analyst database golang Texas |
[email protected] View all |
Fri Aug 18 13:23:00 UTC 2023 |