| .Pyspark Developer || New York || onsite || local prefered at York, New York, USA |
| Email: [email protected] |
| From: Shivendra, Synkriom [email protected] Reply to: [email protected] Experience - 7+ years I need candidate who have strong knowledge in PySpark and also he/she will share his passport number as the mandatory requirement in document Job description Experience building Spark Streaming processes and proficient in distributed computing principles. Managed Hadoop clusters including all associated services. Familiarity with NoSQL databases and messaging systems like Kafka. Designed, built, installed, configured, and supported Hadoop environments. Conducted analysis on large data sets. Strong understanding of cloud technologies. Technical expertise in designing mapping specifications, High-Level Design (HLD), and Low-Level Design (LLD). Ability to communicate effectively with both technical and business team members. Utilized internal tools and SDKs, AWS services such as S3, Athena, and Glue, and integrated with internal Archival Service Platform for data purging. Led integration efforts with internal Archival Service Platform for seamless data purging and lifecycle management. Collaborated with data engineering team to enhance data integration pipelines for evolving business requirements. Keywords: sthree .Pyspark Developer || New York || onsite || local prefered [email protected] |
| [email protected] View all |
| Wed Jul 03 23:05:00 UTC 2024 |