| Big Data Tester Position at Remote, USA at Remote, Remote, USA |
| Email: [email protected] |
| From: Pavan Kumar, Yochana IT [email protected] Reply to: [email protected] Job Description: As Data Engineer, you willtest/maintain, big data solutions. You will be involved in the testing oof data solutions. You will manage the implementing/testing and managing large scale cluster for streaming using technologies like Kafka, Apache Druid, NoSQL DB etc Minimum 6 years oftest/development experiencewith distributed data processing frameworks - Apache Spark, Apache Druid,AWS Lambda, Hadoop, Elastic search, preferably in streaming. Solid hands-on working experience in the following technologies: Experience working on High Availability distributed systems Nice to have experience in fixing issues in the druid code base Testing business logic layers and back-end systemsfor high-volume data pipelines and backend applications. Experience withbuilding/validating/testinglarge scale data processing systems using batch and stream processing Experience in analysing data to identify deliverables, gaps, and inconsistencies in data sets Responsible for full operational lifecycle of streaming platform including cluster sizing, technology selection, deployment, monitoring, scaling & helping with Kafka apps development Responsible for ensuring platform availability and zero downtime Expertise in Containerizing cluster services using Docker and Kubernetes ,OpenShift Solid practical experience of Cluster Administration and Monitoring using Grafana, ElasticSearch, Kibana or similar technologies Demonstrated ability in solutioning covering data ingestion, data cleansing, ETL, data mart creation and exposing data for consumers Experience in developingtest frameworks using Python/javaprogramming Skills Proficient in Java/python and restful web services Proficient in backend API testing and automation Experience with automation test frameworks such as TestNG, Robot framework, and backend automation tools Experience with CI/CD and project management tools ( Gitlab, Github, Jira, Confluence etc.,) Experience with deployment and operations tools (Jenkins, Ansible, Puppet, Terraform) |
| [email protected] View all |
| Tue Oct 25 21:53:00 UTC 2022 |