| Urgent need :: Bigdata Production support :: Baskin, NJ (Day 1 onsite) at Day, New York, USA |
| Email: [email protected] |
| From: Anil, Cygnus [email protected] Reply to: [email protected] Hi, Good Morning! This is Anil and I am sr. Recruiter at Cygnus Pro. I am reaching out to you on below Exciting Job Opportunity with our clients. please reach us with updated resume and details if the job looks suitable to you. Data Engineer Lead (Bigdata Production support) 9+ month Baskin, NJ (Day 1 onsite) - Pls share candidate consent of day 1 onsite. Mandatory Skills: Provide on-call support between 5 PM and 9 PM EST. Job Description : Responsibilities: Monitor production jobs for P1 system (Data Management and Reporting DMR). Debug and restart in the event of production failures. Acknowledge, respond and resolve production issues. Understand change requests / enhancements requests. Design and developed data loading strategies. Build, develop, testing shared components that will be used across modules. Extract source data files, stage, transform and load into EERA system (PostGres SQL) Ingest data from Mainframe system using Kafka and load into EERA. Extract source data files, stage, transform and load into BDS system (Hive based) Use Apache Spark for large data processing integrated with functional programming language Scala Create programs to continuously listen in requests from consumption layer, generate data extracts and publish it via email. On call support during weekend Handshake with offshore team on daily / need basis. Mandatory Skills: Scala, Spark, Hadoop, Kafka Postgres SQL Hive Airflow (or Control M / Oozie) Kubernetes (or equivalent containerization tool) Agile Strong architecture, design & coding skills Experience in production operations and support Experience in distributed databases Nice to have skills Java as some of the UI applications are built in Java. Resource should know Java fundamentals. Best Regards, Anil Reddy | Sr. Technical Recruiter T : 732 485 0000 x 9049. F: (888) 900-6979 E : [email protected] NJ SBE | E-Verify | PA SDB Keywords: user interface access management information technology New Jersey Pennsylvania |
| [email protected] View all |
| Mon Oct 16 23:01:00 UTC 2023 |