| Big Data Developer (Java & Scala) || Onsite- Rockville, MD or NY/NJ || USC ONLY at Rockville, Utah, USA |
| Email: [email protected] |
| Client: FINRA Location: Seeking candidates to work 1 day onsite in Rockville, MD or NY/NJ office location. (Candidates can relocate but should be on EST time zone) Term: 1 year++ Rate: We have mid-level and a senior/lead level. Visa: Only USC Skill Set: Primarily focused on Java Scala experience AWS EMR & Apache Spark (preferred, not a must have) Aurora experience (preferred (serverless) Unit testing is required (JUnit / ScalaTest) good knowledge on how to write proper unit tests and how to automate them Data testing (huge plus if have experience) Experience with Transactional data (not quite streaming data platform) near time processing and batch processing (big plus as this is what they are working on the trade data) Seeking developers who have testing experience as well (as they are looking to combine the roles) Job Description: Required Technical Skills & Knowledge Strong experience in Java or Scala Strong experience in big data technologies like AWS EMR, AWS EKS, Apache Spark Strong experience with serverless technologies like AWS Dynamo DB, AWS Lambda Strong experience in processing with JSON files Must be able to write complex SQL queries Experience in performance tuning and optimization Familiar with columnar storage formats (ORC, Parquet) and various compression techniques Experience in writing Unix shell scripts Unit testing using JUnit or ScalaTest Git/Maven/Gradle Code Reviews Agile Experience & Qualifications 5+ years of experience in programming language Java or Scala 5+ years of experience in ETL projects 3+ years of experience in big data projects 2+ years of experience with API development (REST APIs) and testing (Rest Assured) Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodology Strong and creative analytical and problem-solving skills Job Responsibilities Understand complex business requirements Design and develop ETL pipeline for collecting, validating and transforming data according to the specification Develop automated unit tests, functional tests and performance tests Maintain optimal data pipeline architecture Design ETL jobs for optimal execution in AWS cloud environment Reduce processing time and cost of ETL workloads Participate in peer reviews and design/code review meetings Provide support for production support operations team Implement data quality checks. Identify areas where machine learning can be used to identify data anomalies -- Best Regards Amit Choudhary Senior Technical Recruiter Email: [email protected] Linkedin: https://www.linkedin.com/in/amit-choudhary-086724203/ ANVETA, Inc Address: 1333 Corporate Drive, Suite #108 Irving, TX 75038, USA -- Keywords: database information technology Maryland New Jersey New York Texas Big Data Developer (Java & Scala) || Onsite- Rockville, MD or NY/NJ || USC ONLY [email protected] |
| [email protected] View all |
| Tue Apr 23 22:05:00 UTC 2024 |