| Sr. P Data Engineer (Need 10+) at Ashburn, Virginia, USA |
| Email: [email protected] |
|
http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1225190&uid= Role: Sr. P Data Engineer Duration: 12+ Months Required Qualifications Expertise with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation ETL development experience with strong SQL background Experience in building high-performing data processing frameworks leveraging Google Cloud Platform Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation and aggregation. Experience in utilizing P Services like Big Query, Composer, Dataflow, Pub-Sub, Cloud Monitoring Experience in performing ETL and data engineering work by leveraging multiple google cloud components using Dataflow, Data Proc, BigQuery Experience in scheduling like Airflow, Cloud Composer etc. Experience in JIRA or any other Project Management Tools Experience in CI/CD automation pipeline facilitating automated deployment and testing Experience in bash scripts, UNIX utilities & UNIX Commands Nice to have Qualifications Strong understanding towards Kubernetes, Docker containers and to deploy P services is a plus Knowledge of Scrum/Agile development methodologies is a plus Any experience with Spark, PySpark, or Kafka is a plus Data analysis / Data mapping skills is a plus Knowledge in data manipulation JSON and XML Technical Skills: P Services: DataFlow, BigQuery, Cloud Storage, DataProc, Airflow, Composer, Pub/Sub and Memorystore/Redis Programming languages: Java, Python Streaming ETL: Apache Beam, Kafka Database: Teradata, BigQuery/BigTable -- Thanks & Regards, Rohit Technical Recruiter [email protected] www.insourcetechsolutions.com Marion rd, Westport, CT 06880, -- Keywords: continuous integration continuous deployment information technology Connecticut Texas Virginia http://bit.ly/4ey8w48 https://jobs.nvoids.com/job_details.jsp?id=1225190&uid= |
| [email protected] View All |
| 06:54 PM 18-Mar-24 |