| GCP Or Databricks Data Engineer at New York, New York, USA |
| Email: [email protected] |
| From: Santhoshi, HAN IT Staffing [email protected] Reply to: [email protected] Role: GCP/Databricks Data Engineer - Onsite (Need Local) Location: NEW YORK, NY Client : Capgemini Job Description : Over 7 years experiance , 2 years in Python, Airflow, GCP Biqquery, Databricks with AWS and GCP back groud Designing and implementing highly performant data ingestion pipelines from multiple sources using Databricks,Python, Airflow , Apache Spark on GCP Platform Expert in designing pipelines on various source system. Coverting pipelines from shared service to indiual servers Delivering and presenting proofs of concept to of key technology components to project stakeholders. Developing scalable and re-usable frameworks for ingesting of geospatial data sets Integrating the end to end data pipleline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times Working with event based / streaming technologies to ingest and process data Working with other members of the project team to support delivery of additional project components (API interfaces, Search) Evaluating the performance and applicability of multiple tools against customer requirements Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. Keywords: information technology New York |
| [email protected] View all |
| Thu Dec 21 21:25:00 UTC 2023 |