| Data Engineer with Scala - Remote at Remote, Remote, USA |
| Email: [email protected] |
| From: Praveena Kanakanti, GAC Solutions [email protected] Reply to: [email protected] Hi, This is Praveena from GAC solutions. Hope you are doing good. Role: Data Engineer with Scala Job Location: Remote Job Type: Contract Job Description: Design and develop high-quality software solutions using Scala. Write clean, maintainable, and efficient code in Scala. Utilize object-oriented design principles and functional programming techniques. Handle collections and file operations proficiently. Debug and resolve complex issues in Scala codebases. Build and enhance Spark-based frameworks and pipelines. Conduct unit testing using Scala Unit Test, Mockito, and Junit. Manage build automation tools such as SBT and Maven. Work with various file formats including Parquet, AVRO, CSV, and JSON. Understand and apply Spark architecture principles. Transform and process data using Spark for various data requirements including transactional, relational, dimensional, and unstructured data. Utilize Azure services such as Synapse, ADF, and SQL DB. Understand and implement Spark streaming solutions. Follow Agile methodology for software development. Create and maintain CI/CD pipelines for automated code deployment and configuration management. Qualifications: Proficiency in Scala programming language. Strong experience with Apache Spark Hands-on experience with Azure cloud services (Synapse, ADF, SQL DB). Solid understanding of object-oriented and functional programming concepts. Experience in handling collections and file operations. Strong debugging and error-handling skills. Ability to build and enhance Spark-based frameworks. Experience with unit testing frameworks such as Scala Unit Test, Mockito, and Junit. Proficiency in build automation tools like SBT and Maven. Understanding of various file formats (Parquet, AVRO, CSV, JSON). In-depth knowledge of Spark architecture and data transformation techniques. Experience with data processing for transactional, relational, dimensional, and unstructured data. Knowledge of Spark streaming. Familiarity with Agile methodologies. Experience in creating and maintaining CI/CD pipelines. Must-Have Skills: Scala , Spark , Azure Cloud Services Thanks, Praveena Kanakanti E: [email protected] www.gacsol.com Experts in Digitalization and Engineering - Enterprise 4.0 Keywords: continuous integration continuous deployment database Data Engineer with Scala - Remote [email protected] |
| [email protected] View all |
| Wed Jul 17 02:50:00 UTC 2024 |