Looking for Spark_Data Engineer - Durham, NC (day 1 onsite) at Durham, North Carolina, USA |
Email: [email protected] |
From: Venkat Ram, Neo Tech Solutions, Inc. [email protected] Reply to: [email protected] Hi, Hope you are doing well Please find the below Job Description and let me know if you are interested in applying for this position. Position: Spark/ Data Engineer Duration: Fulltime Location: Durham, NC (day 1 onsite) Job Description: We are currently sourcing for a Java/Spark Engineer to work in Durham, NC! The Role As part of UAP (Unified Acquisition Platform) team you will be working on enhancing the next generation in-house acquisition platform using cloud technologies. UAP will be built using Java Spark and Python programming language and use AWS EMR as the infrastructure for execution. You would be developing lambda, Spark, Python utilities for managing end to end feed flow. We will focus on building tools and capabilities to accelerate acquisition, compare data across vendors, externalize rules for data conversion, build inventory/registry of feeds and track lineage. You would be focusing on: Develop new application for managing feed inventory and tracking their usage Developing application interface using Java Spark for converting vendor feeds into business-friendly format Develop accelerators for new feed acquisition Develop accelerators for data comparison reports Developing Lambda triggers for event driven and batch driven use case Supporting production during warranty period Participate in code review and define standard methodology Manage branching and deployments without conflicts Provide L3 production support Enhancing framework for future needs and make it a more generic product. The Expertise and Skills You Bring Bachelor in information technology 6+ years of experience with application development and hands on experience with Spark/Scala Expertise in providing leadership support by providing technical solutions Expertise in handling huge dataset Expertise in code reviews for standards and efficient coding practices Expertise in building monitoring and alerting tools to report failure or potential performance degradation Experience with TDD (Test driven development) to build unit testing and robust regression test suite Required details for submission Full Name: Email id: Contact Number: Current Location: Relocation: Interview Availability: Notice Period: Visa Status: Any Interviews in Pipeline: Any offers in Pipeline: Last 4 digits of SSN: DOB (MM/DD): Linked in: Pay rate: Thanks & Regards Venkat Ram Talent Acquisition Manager +1 (908) 864-9002 [email protected] Neo Tech Solutions, Inc. Suite 204, 515 Plainfield Ave, Edison, NJ 08817 Keywords: materials management information technology Idaho New Jersey North Carolina |
[email protected] View all |
Tue Feb 28 14:07:00 UTC 2023 |