Big Data Hadoop Lead Developer at Albany, NY at Albany, New York, USA |
Email: [email protected] |
From: Ashok Reddy, Sligo Software Solutions, Inc. [email protected] Reply to: [email protected] Hi, Greetings from Sligo Software Solutions, Inc. !! SLIGO is a Software Development & IT Consulting company. We have around 100+ IT associates working with our esteemed clients across several domains such as IT, Banking, Healthcare, and Government. We have a urgent requirement for Data Technical Lead position with our client. Role: Big Data/ Hadoop Lead with Scala and Spark Location: Albany, New York(Onsite Day 1) Duration: 12 Months Client Job ID#: ANM-001 Duties Lead data engineer and analyst to deliver data sets and analysis results as per business requirements Assemble large, complex data sets that meets functional/Non-Functional business requirements. Automating manual processes, optimizing data delivery, recommending platform greater scalability/improvements Collaborate with initiative leads to optimize and enhance new capabilities Mentor team in migrating Hadoop on-prem to cloud/AWS Create and maintain optimal data pipeline architecture. Presenting analysis results/recommendations using Powerpoint Mandatory Requirements Experience (10+ Years) Requirements This is an 100% Onsite 10+ yrs IT experience and good expertise in SDLC/Agile 3+ yrs Healthcare IT projects 5+ yrs in programing language any (Python, Java, Scala, Spark) Hands on experience in writing advanced SQL queries, familiarity with variety of database Experience in building and optimizing Big-Data pipelines, architecture, and data sets Tools: - Big-Data, Spark, Python, Scala Cloud platform: - AWS S3, Snowflake Experience in Hadoop file formats like ORC, Avro, Parquet, CSV Hands on experience in migrating Hadoop on-prem to cloud/AWS Experience in analyzing data using Big-Data platform, AWS and Snowflake Strong Analytical skills in relating multiple data sets and identify patterns Experience in NoSQL databases like MongoDB and Cassandra Visualize data sets using Power BI or Tableau Desired skills: Kafka streaming and Shell scripting Scheduling tools like Control-M, Oozie NoSQL databases like MongoDB Implement Python flex APIs to share data insights to digital systems Ashok Reddy Akkala Sligo Software Solutions, Inc. NYS and NYC MBE Certified Company Email:[email protected] Office : 518 908 0002 Ext 113 Keywords: business intelligence sthree information technology |
[email protected] View all |
Mon Dec 19 22:23:00 UTC 2022 |