Opportunity: PySpark Developer || New York City, NY | Wilmington, DE | Onsite at New York City, New York, USA |
Email: [email protected] |
From: Deepak, Xforia Inc [email protected] Reply to: [email protected] Title: PySpark Developer Location: New York City, NY | Wilmington, DE | Onsite Duration: 12+ Months Contract Job Description: Experience in building the Spark Streaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop clusters with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs. Keywords: sthree Delaware New York Opportunity: PySpark Developer || New York City, NY | Wilmington, DE | Onsite [email protected] |
[email protected] View all |
Fri Jul 12 02:24:00 UTC 2024 |