| Data Engineer------------Austin TX/Sunnyvale CA (Onsite) at Austin, Texas, USA |
| Email: [email protected] |
| Role- Data Engineer Location- Austin TX/Sunnyvale CA (Onsite) Rate- $60/h Client- TCS/ APPLE * Experience in monitoring and troubleshooting large scale data platforms, data pipelines, complex backend services * Able to effectively communicate incidents, coordinate incident responses, document/manage runbooks, set up processes to support other software engineering teams and data analysts * Experience in managing large datasets * Experience in creating Kubernetes configurations, managing services in Kubernetes, building docker images * Demonstrate good understanding & troubleshooting Spark jobs * Experience in developing/maintaining automation tools in programming/scripting languages like Python * Demonstrate good understanding in Big data eco-systems such as HDFS, Kafka, SQL etc. * Experience in using IT automation tools such as AlgoCD, and job orchestrator systems such as AirFlow, Jenkins * Experience in cloud based environment (AWS/GCP etc.) is a big plus. * Experience in monitoring tools such as Splunk, Prometheus/Grafana is a big plus. * Experience with Full-Stack web development (React, Django etc.) is a big plus. Responsibilities * Support large scale data pipelines and backend services by monitoring and troubleshooting/recovering incidents * Manage large volume datasets in Spark and Hadoop environments using scripts and automation * Build and operate data management infra services * Automate build, deployment, and monitoring * Participate at an onCall & release turn * Taking an oncall turn including weekend coverage Regards, Dharmendra Rana Senior Technical Recruiter Quantum World Technologies Inc. 4281 Katella Ave, Suite # 102 Los Alamitos, CA , 90720, USA 250 Yonge Street, Suite #2201, Unit #10, Toronto, ON, M5B 2L7, Canada 128 City Road, London, EC1V 2NX, United Kingdom.(U.K) www.quantumworldit.com Office: 805-222-0532*217 E: [email protected] Linkedin: https://www.linkedin.com/in/dharmendra-rana-8545b893/ -- Keywords: information technology California Texas |
| [email protected] View all |
| Thu Aug 24 19:25:00 UTC 2023 |