| Senior Big Data Engineer - Java, Apache, Spark & Scala Exp at Sunnyvale, California, USA |
| Email: [email protected] |
| From: ayush, Scalable Systems [email protected] Reply to: [email protected] Job Title: Senior Software Engineer (Big Data) Location: Sunnyvale, CA Responsibilities: Design, develop, and maintain robust software applications using Java, Apache Spark, and Scala. Handle and process large datasets efficiently using messaging systems like Kafka. Develop and optimize Spark/Scala projects to extract valuable insights from data. Write complex SQL queries to manipulate and analyze data. Build and maintain Scala-based services, jobs, and workflows utilizing libraries and dataframes. Conduct performance tuning of Spark applications for optimal efficiency on large datasets. Collaborate with cross-functional teams to deliver high-quality software solutions. Stay up-to-date with the latest advancements in big data technologies. Required Skills and Experience: Strong Software Engineering experience (Application Development) using Java, Apache Spark, Scala, and Kafka for handling/processing large datasets. Proven experience showcasing Spark/Scala projects. Strong SQL skills. Extensive Scala programming experience with a focus on Services, Jobs, Workflows, Libraries, and Dataframes. Deep understanding of REST APIs. Expertise in Spark performance tuning for complex calculations on large datasets. Solid grasp of Apache Spark architecture, components, and concepts. Proficiency in TestNG, SonarQube, Gradle, MSK (Kafka), Spark, Java 11, AWS, Kubernetes, Splunk, and GitHub. Preferred Qualifications: Experience with cloud platforms (AWS, GCP, Azure). Knowledge of machine learning and data mining techniques. Strong problem-solving and analytical skills. Excellent communication and collaboration abilities. Keywords: Java, Apache Spark, Scala, Kafka, Big Data, SQL, REST API, Spark performance tuning, TestNG, SonarQube, Gradle, MSK, AWS, Kubernetes, Splunk, GitHub, Software Engineer, Application Development. Keywords: California Senior Big Data Engineer - Java, Apache, Spark & Scala Exp [email protected] |
| [email protected] View all |
| Wed Aug 07 00:13:00 UTC 2024 |