| Spark Developer || Mclean VA )Day 1 Onsite || CITIZEN,GC EAD,GREEN CARD,H1B,H4 EAD at Mclean, Virginia, USA |
| Email: [email protected] |
| From: jatin parashar, Vyze Inc [email protected] Reply to: [email protected] Hi, I hope you are doing well, Job Description JOB TITLE: Spark Developer with ETL Duration: Long Term Location: Mclean VA )Day 1 Onsite PLEASE SHARE BEFORE 1990 BORN CANDIDATES AND PASSPORT NUMBER IS MANDATORY MUST HAVE: Must be strong in Spark/Bigdata, ETL and Pyspark and Python Your expertise in Python, PySpark, ETL processes, CI/CD (Jenkins or GitHub), and experience with both streaming and batch workflows will be essential in ensuring the efficient flow and processing of data to support our clients. Collaborate with cross-functional teams to understand data requirements and design robust data architecture solutions Implement ETL processes to extract, transform, and load data from various sources Ensure data quality, integrity, and consistency throughout the ETL pipeline Utilize your expertise in Python and PySpark to develop efficient data processing and analysis scripts Optimize code for performance and scalability, keeping up-to-date with the latest industry best practices Integrate data from different systems and sources to provide a unified view for analytical purposes Collaborate with data analysts to implement solutions that meet their data integration needs Design and implement streaming workflows using PySpark Streaming or other relevant technologies Develop batch processing workflows for large-scale data processing and analysis Keywords: continuous integration continuous deployment Virginia |
| [email protected] View all |
| Wed Feb 28 19:42:00 UTC 2024 |