| Urgent Requirement || Python Spark Developer || Columbus, OH( Local Only) || c2c(H1B/H4EAD ONLY) at Columbus, Ohio, USA |
| Email: [email protected] |
| Please share Python Spark locals Only Job Role : Python Spark Developer Location : Columbus, OH(local Only) Experience : 9+ Years Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scaladoc-style documentation for code. Optimize Spark queries for performance. Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL). Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus). Skills: Proficiency in Python, Scala (with a focus on functional programming), and Spark. Familiarity with Spark APIs, including RDD, Data Frame, MLlib, GraphX, and Streaming. Experience working with HDFS, S3, Cassandra, and/or DynamoDB. Deep understanding of distributed systems. Experience with building or maintaining cloud-native applications. Familiarity with serverless approaches using AWS Lambda is a plus Best Regards www.diverselynx.com Sapna Verma E-Mail: [email protected] Diverse Lynx LLC, 300 Alexander Park, Suite 200. Princeton, NJ 08520. -- Keywords: sthree information technology New Jersey Ohio Urgent Requirement || Python Spark Developer || Columbus, OH( Local Only) || c2c(H1B/H4EAD ONLY) [email protected] |
| [email protected] View all |
| Tue Jun 11 21:07:00 UTC 2024 |