| big data development at NYC, New York, USA |
| Email: [email protected] |
| From: Syeda Hajra, Absolute IT [email protected] Reply to: [email protected] Role :Big Data Development (who can work as a Lead) (Financial Domain) Location : NYC, NY (Local or who is willing to work on-site 2/3days a week) Long Term Consulting Assignment Client : Morgan Stanley As a Big Data Platform Engineer you will be responsible for our Big Data platform's stability and the design and development of core functionality and strategic solutions that utilize big data technologies in order to meet our constantly changing business requirements. This includes the development of reusable tooling / APIs, an efficient entitlements models, and software stack to accelerate our current big data development and analytics solutions. Responsibilities include: Designing and developing strategic technology solutions on Hadoop based on business requirement Collaboration within the organization on current and future state architecture Hands-on development working within a global development Monitoring platform processes and activities across various analytics teams to ensure platform stability Coordination with our DevOps teams, infrastructure engineers, and production support to triage and resolve issues and efficiently manage resource capacity of our Big Data platform Skills Required: 5-7 years of appropriate technical experience Proficiency with developing software with Scala and Python Experience with Spark for data processing Experience maintaining Cloudera Hadoop infrastructure such as HDFS, YARN, Spark, Impala and edge nodes High quality software architecture and design methodologies and patterns Strong SQL skills with commensurate experience in a large database platform. Complete SDLC process and Agile Methodology (Scrum) Strong oral and written communication skills Skills Desired: Experience with Core Java Experience with XML/JSON technologies Experience with Data Federation or Virtualization technologies Experience with developing Cloud-based Big Data solutions Experience with tools / platforms / technologies like Dataiku, ElasticSearch, etc. Experience in development on other application types (Web applications, batch, or streaming) Keywords: information technology New York |
| [email protected] View all |
| Wed Jan 25 17:48:00 UTC 2023 |