| Data Engineer***Candidates must be US Citizens***in Irving, TX at Irving, Texas, USA |
| Email: [email protected] |
| From: ranjeet kumar, source infotech inc [email protected] Reply to: [email protected] Hi, Job Title: Data Engineer Location: Irving, TX Length: 4-6 months ***Candidates must be US Citizens*** The client is adding customers to their new digital platform (Spark) which is built on Kubernetes running in AZURE, the customer and associate experience (CX/AX) on their new SPARK platform in EMEA. They are planning to migrate North American operating companies (OPCOs) to the platform, beginning in 2024. With this integration work the engineer will be responsible for designing, configuring, and implementing data validation tools which will validate the data transferred between. You will ensure best practices are followed through the implementation lifecycle and help construct data sets for use by the team and other business stakeholders to power both reporting and validation. Specific Job Description: Job responsibilities Highly skilled and motivated Data Engineer As a Data Engineer, you will be responsible for validating the data between two systems, ensuring accuracy and consistency. Implement data quality checks and monitoring processes. Design and Develop data entity validation scripts using python. Validate and reconcile data between two systems, ensuring accuracy and consistency. Collaborate with cross-functional teams to identify and resolve data discrepancies and issues. Develop and implement data quality checks and monitoring processes to ensure data integrity. Design and maintain data pipelines and ETL processes to extract, transform, and load data from various sources. Optimize data storage and retrieval processes to improve performance and efficiency. Perform data analysis and profiling to identify data quality issues and recommend solutions. Develop and maintain documentation for data validation processes, data mappings, and data lineage. Stay up to date with industry trends and best practices in data engineering and data validation. Support migration of North American OPCOs, enabling data validation on the new platform. Gather business requirements from key client stakeholders and translate these into technical tracking specifications based on standards and industry best practice. Required Skills Strong knowledge of IPAAS and data validation for migration of applications. Demonstrable experience in delivering end to end data validation. Confident understanding of web development and its languages and possess Python proficiency. Proactive and highly organized with strong time management and planning skills. Able to change direction and work on multiple projects across a wide range of topics. [Desired] Knowledge of Python/Google BigQuery architecture. I would appreciate your valuable reply. Have a nice day. Thanks and regards Ranjeet kumar , IT-Technical Recruiter Source Infotech Inc P.O. Box 577, EDISON, NJ 08818-0577 Web:www.sourceinfotech Id: [email protected] Disclaimer: If you are not interested in receiving our e-mails then please reply with a "REMOVE" in the subject line at [email protected] for automatic removal. And mention all the e-mail addresses to be removed with any e-mail addresses, which might be diverting the e-mails to you. We are sorry for the inconvenience. Keywords: information technology Idaho New Jersey Texas |
| [email protected] View all |
| Mon Sep 18 23:39:00 UTC 2023 |