Home

Sr. GCP Data Engineer with Java (Need locals in Texas) at Ashburn, Virginia, USA
Email: [email protected]
Role: Sr. GCP Data Engineer with Java

Client Location: Ashburn, VA or Irving, TX (2-3 days onsite)

Duration: 12+ Months

Required Qualifications

        Expertise with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation

        ETL development experience with strong SQL background

        Experience in building high-performing data processing frameworks leveraging Google Cloud Platform

        Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation and aggregation.

        Experience in utilizing GCP Services like Big Query, Composer, Dataflow, Pub-Sub, Cloud Monitoring

        Experience in performing ETL and data engineering work by leveraging multiple google cloud components using Dataflow, Data Proc, BigQuery

        Experience in scheduling like Airflow, Cloud Composer etc.

        Experience in JIRA or any other Project Management Tools

        Experience in CI/CD automation pipeline facilitating automated deployment and testing

        Experience in bash shell scripts, UNIX utilities & UNIX Commands

        Nice to have Qualifications

        Strong understanding towards Kubernetes, Docker containers and to deploy GCP services is a plus

        Knowledge of Scrum/Agile development methodologies is a plus

        Any experience with Spark, PySpark, or Kafka is a plus

        Data analysis / Data mapping skills is a plus

        Knowledge  in data manipulation JSON and XML

Technical Skills:

GCP Services:  DataFlow, BigQuery, Cloud Storage, DataProc, Airflow, Composer, Pub/Sub and Memorystore/Redis

Programming languages: Java, Python

Streaming ETL: Apache Beam, Kafka

Database: Teradata, BigQuery/BigTable

--

Thanks & Regards,

Rohit

Technical Recruiter

[email protected]

www.insourcetechsolutions.com

Marion rd, Westport, CT 06880,

--

Keywords: continuous integration continuous deployment information technology Connecticut Texas Virginia
[email protected]
View all
Thu Mar 21 20:06:00 UTC 2024

To remove this job post send "job_kill 1239385" as subject from [email protected] to [email protected]. Do not write anything extra in the subject line as this is a automatic system which will not work otherwise.


Your reply to [email protected] -
To       

Subject   
Message -

Your email id:

Captcha Image:
Captcha Code:


Pages not loading, taking too much time to load, server timeout or unavailable, or any other issues please contact admin at [email protected]
Time Taken: 7

Location: Ashburn, Virginia