Databricks testers at Remote, Remote, USA |
Email: [email protected] |
From: Eli, RCube Creative Consulting [email protected] Reply to: [email protected] Position: Data Bricks testers Location - Remote Visa - EAD, GC or H1B Client - CTS Databricks Tester Job Overview: We are seeking a skilled and detail-oriented Databricks Tester to join our dynamic team. The ideal candidate will have a strong background in testing big data platforms, with specific expertise in Databricks. As a Databricks Tester, you will play a crucial role in ensuring the quality and reliability of our data processing and analytics systems. Responsibilities: 1. Test Planning and Strategy: Collaborate with development and product teams to understand project requirements and define comprehensive test plans. Develop test strategies specifically tailored for Databricks environments. 2. Test Case Design and Execution: Design, create, and execute test cases for Databricks-based applications and workflows. Perform functional, integration, and regression testing to validate the behavior of Databricks jobs and notebooks. 3. Automation: Develop and maintain automated test scripts for Databricks using relevant testing frameworks. Implement continuous integration and delivery pipelines for automated testing. 4. Performance Testing: Conduct performance testing to assess the scalability and efficiency of Databricks clusters and jobs. Identify and address performance bottlenecks in collaboration with development teams. 5. Data Validation: Verify the accuracy and integrity of data processed by Databricks jobs. Ensure that data transformations and computations align with business requirements. 6. Issue Identification and Reporting: Document and report defects, issues, and anomalies discovered during testing. Work closely with developers to ensure timely resolution of identified issues. 7. Collaboration: Collaborate with cross-functional teams, including developers, data engineers, and business analysts. Participate in sprint planning, reviews, and retrospectives. Qualifications: 1. Bachelor's degree in Computer Science, Information Technology, or related field. 2. Proven experience in testing Databricks environments and big data platforms. 3. Strong understanding of Spark-based data processing and analytics. 4. Proficiency in programming/scripting languages such as Python, Scala, or SQL. 5. Experience with test automation tools and frameworks for big data, such as PySpark, ScalaTest, or others. 6. Knowledge of data warehousing concepts and ETL processes. 7. Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their integration with Databricks. 8. Excellent analytical and problem-solving skills. 9. Effective communication and collaboration skills. Preferred Qualifications: 1. Databricks certification. 2. Experience with version control systems (e.g., Git). 3. Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes). 4. Knowledge of security best practices for big data platforms. If you are a passionate Databricks Tester with a keen eye for detail and a commitment to delivering high-quality solutions, we invite you to apply and be a key contributor to our innovative and dynamic team. Keywords: green card |
[email protected] View all |
Tue Nov 21 20:37:00 UTC 2023 |