| data engineer---face to face interview at Remote, Remote, USA |
| Email: [email protected] |
| Job Title: PySpark Data Engineer Location: PA,NYC,NJ only with DL Locals Only final interview will be face to face Hybrid at PA Contract C2C/w2/1099 Job Description: We are seeking a skilled PySpark Data Engineer to join our dynamic data engineering team. The ideal candidate will have hands-on experience with big data technologies, especially PySpark, and a solid understanding of data processing, data pipelines, and data architecture. This role will involve designing, developing, and optimizing large-scale data processing systems to support data-driven decision-making across the organization. Responsibilities: Develop and Implement Data Pipelines: Design and implement scalable, reliable, and efficient data pipelines using PySpark for processing large datasets. Data Ingestion and Transformation: Develop PySpark scripts for extracting, transforming, and loading (ETL) data from various structured and unstructured data sources. Optimize Performance: Tune PySpark jobs for performance and scalability, ensuring efficient use of resources and minimizing processing times. Data Modeling: Collaborate with data architects and analysts to design and implement data models that support business needs and analytics. Collaborate with Stakeholders: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and provide the necessary infrastructure. Monitor and Maintain Pipelines: Set up monitoring and alerting systems to ensure the reliability and performance of data pipelines, and address any issues that arise. Implement Best Practices: Follow and promote best practices in coding, data engineering, and data management, including version control, code reviews, and documentation. Kind Regards, Syeda Hajra | Absolute IT | Senior Technical Recruiter 116 Village Blvd Suite 200 Princeton New Jersey 08540 Absolute IT [email protected] https://www.linkedin.com/in/syeda-hajra-a96813245/ www.absoluting.com -- Keywords: information technology wtwo New Jersey Pennsylvania data engineer---face to face interview [email protected] |
| [email protected] View all |
| Tue Aug 20 23:59:00 UTC 2024 |