| Spark Developer Saint Louis, MO (Hybrid) at Saint Louis, Missouri, USA |
| Email: [email protected] |
| From: Debasish Pattnaik, MRTECHNOSOFT [email protected] Reply to: [email protected] Job Title: Spark Developer Location: Saint Louis, MO (Hybrid) Job Type: Contract Job Description: We are seeking an experienced Spark Developer to join our team in Saint Louis, MO. This is a hybrid role, offering a mix of remote and on-site work. The ideal candidate will have a strong background in big data processing and a passion for working with large-scale data sets. Key Responsibilities: Design, develop, and maintain scalable and efficient Spark applications. Collaborate with data engineers, data scientists, and other stakeholders to define, design, and implement big data solutions. Optimize Spark jobs for performance and scalability. Ensure the performance, quality, and responsiveness of big data applications. Identify and resolve bottlenecks and bugs in Spark applications. Help maintain code quality, organization, and automation. Participate in code reviews and provide constructive feedback to peers. Stay up-to-date with the latest industry trends and technologies in big data processing. Required Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 3+ years of professional experience in big data development using Apache Spark. Proficiency in Scala, Python, or Java for Spark development. Strong understanding of distributed computing principles. Experience with big data processing and ETL pipelines. Familiarity with Hadoop ecosystem components (HDFS, Hive, HBase, etc.). Knowledge of database systems (SQL and NoSQL). Experience with version control systems, preferably Git. Preferred Qualifications: Experience with cloud platforms (AWS, Azure, GCP) and their big data services. Understanding of data warehousing concepts. Familiarity with containerization technologies like Docker and Kubernetes. Experience with continuous integration and continuous deployment (CI/CD) pipelines. Knowledge of real-time data processing frameworks such as Kafka or Flink. Thanks Debasish Pattnaik [email protected] www.mrtechnosoft.com Keywords: continuous integration continuous deployment Missouri Spark Developer Saint Louis, MO (Hybrid) [email protected] |
| [email protected] View all |
| Wed Jul 24 21:39:00 UTC 2024 |