Spark, Scala, SQL Developer Saint Louis, MO (Hybrid) at Saint Louis, Missouri, USA |
Email: [email protected] |
Job Title: Spark, Scala, SQL Developer Location: Saint Louis, MO (Hybrid) Job Type: Contract Job Description: We are seeking an experienced Developer proficient in Spark, Scala, and SQL to join our team in Saint Louis, MO. This is a hybrid role, offering a mix of remote and on-site work. The ideal candidate will have a strong background in big data processing, functional programming, and database development. Key Responsibilities: Spark Development: Design, develop, and maintain scalable and efficient Spark applications. Optimize Spark jobs for performance and scalability. Identify and resolve bottlenecks and bugs in Spark applications. Scala Development: Design, develop, and maintain scalable and robust Scala applications. Collaborate with cross-functional teams to define, design, and ship new features. Ensure the performance, quality, and responsiveness of applications. SQL Development: Design, develop, and maintain complex SQL queries, stored procedures, and functions. Optimize database performance and troubleshoot performance issues. Perform data modeling, database design, and normalization. Collaborate with data engineers, data scientists, software developers, and other stakeholders to define, design, and implement big data solutions. Participate in code reviews and provide constructive feedback to peers. Stay up-to-date with the latest industry trends and technologies. Required Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 3+ years of professional experience in big data development using Apache Spark. Proficiency in Scala, with a strong understanding of functional programming principles. 3+ years of professional experience in SQL development. Strong understanding of database concepts, normalization, and data modeling. Familiarity with Hadoop ecosystem components (HDFS, Hive, HBase, etc.). Knowledge of database performance tuning and optimization techniques. Experience with version control systems, preferably Git. Preferred Qualifications: Experience with cloud platforms (AWS, Azure, GCP) and their big data services. Knowledge of real-time data processing frameworks such as Kafka or Flink. Understanding of data warehousing concepts and technologies. Familiarity with containerization technologies like Docker and Kubernetes. Experience with continuous integration and continuous deployment (CI/CD) pipelines. Familiarity with reporting and BI tools such as Tableau, Power BI, or SSRS. Keywords: continuous integration continuous deployment business intelligence Missouri |
[email protected] View all |
Thu Jul 25 21:07:00 UTC 2024 |