Immediate Requirement for Data Quality Engineer at Cincinnati, OH - Hybrid at Cincinnati, Ohio, USA |
Email: [email protected] |
From: Avinash Kumar, ZealHire Inc [email protected] Reply to: [email protected] Position: Data Quality Engineer Location: Cincinnati, OH - Hybrid Duration: Long-Term Contract Visa Status: Only USC/GC/GC EAD Job Description: USC/GC need LinkedIn and VISA DL Note: Role requires the consultant to be in Cincinnati, OH once he has an offer. Candidates from EST & CST Time zones are okay and must be able to relocate. Min 10 Yrs. genuine exp profile required. Overview: We are seeking a skilled Data Quality Engineer to join our team and play a critical role in ensuring the reliability, accuracy, and consistency of data within our warehouse and manufacturing data platform in the Kroger supply chain space. While the title may suggest a focus on quality assurance, this role requires a blend of data engineering and testing expertise. The Data Quality Engineer will be responsible for implementing robust test frameworks, writing automation test cases, and collaborating closely with data engineers to validate and verify the functionality of data pipelines and processes. This is a key role in maintaining the integrity of our data platform and driving continuous improvement in data quality standards. Technical Skills: Proficiency in data engineering technologies such as Azure Databricks, Synapse Analytics, and SQL Hyperscale. Strong programming skills in Python and PySpark for developing automation test scripts. Experience with building and implementing test frameworks for data-centric applications in Azure cloud environments. Knowledge of data quality assurance methodologies and best practices. Familiarity with version control systems and CI/CD pipelines for automated testing and deployment. Understanding of data modeling, ETL processes, and data warehousing concepts. Key Responsibilities Collaborate with data engineers to understand data pipelines, transformations, and business rules to develop comprehensive test strategies. Design, implement, and maintain test frameworks for validating data quality, completeness, and accuracy across all stages of the data lifecycle. Develop automation test scripts using Python and PySpark to execute test cases against data pipelines and processes. Conduct regression testing to ensure the stability and reliability of data pipelines after code changes or updates. Implement monitoring and alerting mechanisms to proactively identify and address data quality issues in production environments. Work closely with cross-functional teams to define acceptance criteria and ensure that data quality requirements are met. Document test cases, test results, and defects to facilitate collaboration and knowledge sharing within the team. Continuously evaluate and improve testing processes and methodologies to enhance data quality assurance practices. Stay updated on emerging technologies and trends in data quality engineering, and incorporate them into our testing practices as appropriate. Keywords: continuous integration continuous deployment green card Ohio |
[email protected] View all |
Wed Mar 13 19:19:00 UTC 2024 |