| Hadoop Engineer || Charlotte NC || Need 14+ years || Only EST Time Zone Candidates at Charlotte, North Carolina, USA |
| Email: [email protected] |
| From: Ram, Atlantis [email protected] Reply to: [email protected] Title: Hadoop Engineer Location: Charlotte NC Duration: Long Term Responsibilities: Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption. Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger. Design and develop automated testing framework to perform data validation. Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations. Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture. Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions. Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure. Support ongoing data management efforts for Development, QA and Production environments Provide tool support, help consumers troubleshooting pipeline issues. Utilizes a thorough understanding of available technology, tools, and existing designs. Leverage knowledge of industry trends to build best in class technology to provide competitive advantage. Keywords: quality analyst Colorado North Carolina Hadoop Engineer || Charlotte NC || Need 14+ years || Only EST Time Zone Candidates [email protected] |
| [email protected] View all |
| Wed Nov 06 02:49:00 UTC 2024 |