Urgent Requirement:: Big Data Engineer : Hybrid (Houston, TX, 77077) at Houston, Texas, USA |
Email: tushar.chauhan@tekishub.us |
Hello, Please find the job description for Big Data Engineer Job Title: Big Data Engineer Location: Hybrid (Houston, TX, 77077) Must-Have Skills: Spark Databricks SQL Detailed Job Description: Develop and maintain data pipelines using Apache Spark and Scala to process large volumes of data efficiently. Implement data transformation logic to cleanse, normalize, and aggregate data from various sources, ensuring high data quality and consistency. Integrate data from different systems and sources, including structured and unstructured data, databases, and Mainframe systems, ensuring seamless data flow and compatibility. Implement data validation and quality checks within data pipelines to ensure data accuracy, consistency, and integrity, and handle exception handling and error logging. Develop and execute unit tests, integration tests, and end-to-end tests to ensure the reliability and correctness of Spark applications. Debug and troubleshoot issues during development and production phases Thanks & Regards Tushar Chauhan Technical Recruiter tushar.chauhan@tekishub.us 302-307-1046 Ext. 291 https://www.linkedin.com/in/tushar-chauhan-aa8849239/ TekisHub Consulting Services Derive | Drive | Deliver Keywords: Texas https://jobs.nvoids.com/job_details.jsp?id=2336696 |
tushar.chauhan@tekishub.us View All |
08:51 PM 11-Apr-25 |