Lead Big Data Engineer at Remote, Remote, USA |
Email: [email protected] |
From: Lovely Singh, Tek Inspiration [email protected] Reply to: [email protected] Hi, Hope you are doing great!!! Please share suitable profile Lead Big Data Engineer Hybrid- NYC, NY onsite Must haveHDFS, YARN, Spark, Impala, cloudera(CDH) Big datahands on experience 5-7 years of appropriate technical experience. Need 9-10years of experience. As a Big DataPlatform Engineer you will be responsible for our Big Data platform's stabilityand the design and development of core functionality and strategic solutionsthat utilize big data technologies in order to meet our constantly changingbusiness requirements. This includes the development of reusable tooling /APIs, an efficient entitlements models, and software stack to accelerate ourcurrent big data development and analytics solutions. Responsibilitiesinclude: Designing anddeveloping strategic technology solutions on Hadoop based on businessrequirement Collaboration within the organization on current and future state architecture Hands-on development working within a global development Monitoring platform processes and activities across various analytics teams to ensure platform stability Coordination with our DevOps teams, infrastructure engineers, and production support to triage and resolve issues and efficiently manage resource capacity of our Big Data platform Skills Required: 5-7 years of appropriate technical experience Proficiency with developing software with Scala and Python Experience with Spark for data processing Experience maintaining Cloudera Hadoop infrastructure such as HDFS, YARN, Spark, Impala and edge nodes High quality software architecture and design methodologies and patterns Strong SQL skills with commensurate experience in a large database platform. Complete SDLC process and Agile Methodology (Scrum) Strong oral and written communication skills Experience with Core Java Experience with XML/JSON technologies Experience with Data Federation or Virtualization technologies Experience with developing Cloud-based Big Data solutions Experience with tools / platforms / technologies like Dataiku, ElasticSearch, etc. Experience in development on other application types (Web applications, batch, or streaming) REGARD Lovely Singh Keywords: New York |
[email protected] View all |
Tue Feb 28 15:06:00 UTC 2023 |