Urgent opening for GCP Data Engineer (Alpharetta, GA) at Alpharetta, Georgia, USA |
Email: [email protected] |
Hi Team, We are having Urgent opening for GCP Data Engineer (Alpharetta, GA ) Job Title: GCP Data Engineer Long Term Contract Location: Alpharetta, GA Exp: 10+Years GCP certification(s) in relevant areas. Experience with CI/CD (Continuous Integration/Continuous Deployment) pipelines for data engineering. Job Description: Key Responsibilities: 1. Data Pipeline Development: Design, build, and maintain data pipelines on GCP, utilizing tools such as Dataflow, Dataprep, and BigQuery for batch and real-time data processing. 2. Data Ingestion: Implement efficient data ingestion processes to collect data from various sources, ensuring data is collected reliably and securely. 3. Data Transformation: Perform data transformation, cleansing, and enrichment to prepare data for analysis and reporting, leveraging tools like Dataflow and Cloud Dataprep. 4. Data Quality Assurance: Establish data quality checks and monitoring mechanisms to ensure data accuracy, consistency, and completeness. 5. Data Warehousing: Design and manage data warehousing solutions using Google BigQuery or other appropriate GCP services. 6. Security and Compliance: Ensure data security and compliance with relevant data privacy regulations, implementing access controls, encryption, and auditing as necessary. 7. Documentation: Create and maintain comprehensive documentation for data pipelines, processes, and best practices to facilitate knowledge sharing within the team. 8. Collaboration: Collaborate closely with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver solutions aligned with business needs. 9. Monitoring and Troubleshooting: Implement monitoring and alerting solutions to proactively identify and address data pipeline issues. 10. Cost Optimization: Optimize data storage and processing costs on GCP by managing resource allocation efficiently. Qualifications: Bachelor's or Master's degree in Computer Science, Information Technology, or a related field. Proven experience as a data engineer, with a focus on GCP technologies. Strong expertise in GCP services like BigQuery, Dataflow, Pub/Sub, and Cloud Storage. Proficiency in SQL and database management. Experience with data modelling and ETL (Extract, Transform, Load) processes. Familiarity with cloud-native data architectures and best practices. Strong problem-solaving skills and attention to detail. Excellent communication and collaboration skills. Ability to work independently and meet project deadlines. Preferred Qualifications: Knowledge of data governance and data cataloging tools on GCP. Ruchi Verma US IT Recruiter [email protected] | 470-289-7455 -- Keywords: continuous integration continuous deployment information technology Georgia |
[email protected] View all |
Mon Sep 11 20:13:00 UTC 2023 |