| PythonPySparkwithAWS - Plano TX and Wilmington DE- Onsite- Need: 12+Exp at Plano, Texas, USA |
| Email: [email protected] |
| From: Laxmivijay, Procorp Systems [email protected] Reply to: [email protected] Hello Hope you re doing well! Job Role: Python PySpark with AWS Location: Plano TX / Wilmington DE- Onsite Experience: 12+ Years Please share candidate LinkedIn and Visa Status. Duties and responsibilities Job Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scala doc-style documentation for code. Optimize Spark queries for performance. Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL). Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus). Skills: Proficiency in Python, Scala (with a focus on functional programming), and Spark. Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming. Experience working with HDFS, S3, Cassandra, and/or DynamoDB. Deep understanding of distributed systems. Experience with building or maintaining cloud-native applications. Familiarity with serverless approaches using AWS Lambda is a plus Thanks & Regards Laxmivijay US IT Technical Recruiter. ProCorp Systems Inc 2222 W Spring Creek Pkwy, STE 202,Plano,Texas 75023 Mail: [email protected] LinkedIn: https://www.linkedin.com/in/laxmi-vijay-a5aa47231/ -> https://procorpsystems.co/ Keywords: sthree information technology Colorado Delaware Texas PythonPySparkwithAWS - Plano TX and Wilmington DE- Onsite- Need: 12+Exp [email protected] |
| [email protected] View all |
| Fri Oct 11 19:11:00 UTC 2024 |