Hiring : Python spark -Columbus, OH(3 day onsite per week) at Columbus, Ohio, USA |
Email: [email protected] |
From: Sumit kumar, Tanisha systems Inc [email protected] Reply to: [email protected] Greetings, My name is Sumit, and I am Delivery Manager at. Tanisha Systems Inc is a global contingency staffing firm servicing. We have an excellent job opportunity with one of our clients. Job Title: Python spark Location: Columbus, OH ( 3 day onsite per week) Experience: 9+Year Job details: Responsibilities: Develop and maintain data platforms using Python, Spark, and PySpark. Handle migration to PySpark on AWS. Design and implement data pipelines. Work with AWS and Big Data. Produce unit tests for Spark transformations and helper methods. Create Scala/Spark jobs for data transformation and aggregation. Write Scaladoc-style documentation for code. Optimize Spark queries for performance. Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL). Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus). Skills: Proficiency in Python, Scala (with a focus on functional programming), and Spark. Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming. Experience working with HDFS, S3, Cassandra, and/or DynamoDB. Deep understanding of distributed systems. Experience with building or maintaining cloud-native applications. Familiarity with serverless approaches using AWS Lambda is a plus Sumit kumar Delivery Manager, Tanisha Systems Inc Phone : 7323785374| Ext 474 : [email protected] | Address : 99 Wood Ave South Suite # 308,Iselin, NJ 08830 Linkedin: https://www.linkedin.com/in/sumit-kumar-6aa1aa20b/ Note:- Email is the best way to connect Keywords: access management sthree New Jersey Ohio Hiring : Python spark -Columbus, OH(3 day onsite per week) [email protected] |
[email protected] View all |
Wed Jun 12 03:57:00 UTC 2024 |