Need || Lead Data Engineer || 12+ Months || Baskin, NJ (Onsite) at Remote, Remote, USA |
Email: [email protected] |
* REMOVE in subject line. * HI, HOPE YOU ARE DOING GREAT TODAY. LET ME KNOW IF YOU ARE INTERESTED IN BELOW REQUIREMENT. PLEASE SEND THE SUITABLE RESUME ALONG WITH CONTACT DETAILS, CURRENT LOCATION ASAP ON [email protected] Title: Data Engineer Lead (Bigdata Production support) Work Location: Baskin, NJ (Day 1 onsite) Duration: 12+ Months Mandatory Skills: Scala, Spark, Hadoop, Kafka Postgres SQL Hive Airflow (or Control M / Oozie) Kubernetes (or equivalent containerization tool) Agile Strong architecture, design & coding skills Experience in production operations and support Experience in distributed databases Job Description: Monitor production jobs for P1 system (Data Management and Reporting DMR). Debug and restart in the event of production failures. Acknowledge, respond and resolve production issues. Understand change requests / enhancements requests. Design and developed data loading strategies. Build, develop, testing shared components that will be used across modules. Extract source data files, stage, transform and load into EERA system (PostGres SQL) Ingest data from Mainframe system using Kafka and load into EERA. Extract source data files, stage, transform and load into BDS system (Hive based) Use Apache Spark for large data processing integrated with functional programming language Scala Create programs to continuously listen in requests from consumption layer, generate data extracts and publish it via email. On call support during weekend Handshake with offshore team on daily / need basis. Thanks & Regards Bhavanesh Eamani Lead Technical Recruiter PH : 9724400073 Agile Enterprise Solutions Inc. 7460 Warren Pkwy,Suite 100, Frisco, TX 75034. Email: [email protected] Website: www.aesincus.com LinkedIN: https://www.linkedin.com/in/bhavanesh-eamani-741a1a1ba/ * REMOVE in subject line. * Keywords: information technology New Jersey Texas |
[email protected] View all |
Mon Oct 16 23:02:00 UTC 2023 |