| Opportunity: Data Engineer with PySpark || New York City, NY | Wilmington, DE | Onsite at New York City, New York, USA |
| Email: [email protected] |
| From: dhana, Xforia Inc [email protected] Reply to: [email protected] Title: Data Engineer with PySpark Location: New York City, NY | Wilmington, DE | Onsite Duration: 12+ Months Contract Job Description: Work in tandem to design, develop, and implement machine learning pipelines. Utilize PySpark for data processing, transformation, and preparation for model training. Implement and manage ETL workflows using Stream sets for data ingestion and transformation. Design and construct pipelines to deliver high-quality training and inference datasets. Collaborate with cross-functional teams to ensure smooth deployment and real-time/near real-time inferencing capabilities. Optimize and fine-tune pipelines for performance, scalability, and reliability. Implement Spark architecture and optimize Spark jobs for scalable data processing. Keywords: Delaware New York Opportunity: Data Engineer with PySpark || New York City, NY | Wilmington, DE | Onsite [email protected] |
| [email protected] View all |
| Thu Jul 04 04:57:00 UTC 2024 |