Opportunity: Data Engineer with PySpark || New York City, NY | Wilmington, DE | Onsite at New York City, New York, USA |
Email: [email protected] |
From: Deepak, Xforia Inc [email protected] Reply to: [email protected] Title: Data Engineer with PySpark Location: New York City, NY | Wilmington, DE | Onsite Duration: 12+ Months Contract Job Description: Work in tandem to design, develop, and implement machine learning pipelines. Utilize PySpark for data processing, transformation, and preparation for model training. Implement and manage ETL workflows using Stream sets for data ingestion and transformation. Design and construct pipelines to deliver high-quality training and inference datasets. Collaborate with cross-functional teams to ensure smooth deployment and real-time/near real-time inferencing capabilities. Optimize and fine-tune pipelines for performance, scalability, and reliability. Implement Spark architecture and optimize Spark jobs for scalable data processing. www.xforia.com Deepak M.V Recruitment Manager 9300 Wade Boulevard, Suite 220, Frisco TX 75035, USA. Keywords: Delaware New York Texas Opportunity: Data Engineer with PySpark || New York City, NY | Wilmington, DE | Onsite [email protected] |
[email protected] View all |
Wed Jul 03 18:47:00 UTC 2024 |