| Need Lead Spark developer in Remote(USA) at Remote, Remote, USA |
| Email: john.p@siriinfo.com |
|
From: John Papatla, siri info solutions.inc john.p@siriinfo.com Reply to: john.p@siriinfo.com Hello, Hope you are doing well!! Greeting from Siri Info Solutions. I am John with Siri Info Solutions. We Siri Info Solutions is a global staff augmentation firm providing a wide-range of talent on-demand and total workforce solutions. We have an immediate opening for the below position with one of our premium clients Job Title: Lead Spark developer Location: Remote(USA) Duration: Long Term Job Description: We are looking for a Spark developer who knows how to fully exploit the potential of our Spark cluster. You will clean, transform, and analyze vast amounts of raw data from various systems using Spark to provide ready-to-use data to our feature developers and business analysts. Responsibilities: Create Scala/Spark jobs for data transformation and aggregation Produce unit tests for Spark transformations and helper methods Write Scala doc-style documentation with all code Design data processing pipelines Required Skills: Scala (with a focus on the functional programming paradigm) Scalatest, JUnit, Mockito, Embedded Cassandra Apache Spark 2.x Apache Spark RDD API Apache Spark SQL Data Frame API Apache Spark MLlib API Apache Spark GraphX API Apache Spark Streaming API Spark query tuning and performance optimization SQL database integration Microsoft, Oracle, Postgres, and/or MySQL Experience working with HDFS, S3, Cassandra and/or DynamoDB Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus) This involves both ad-hoc requests as well as data pipelines that are embedded in our production environment. Keywords: access management sthree active directory https://jobs.nvoids.com/job_details.jsp?id=1034539 |
| john.p@siriinfo.com View All |
| 02:13 AM 20-Jan-24 |