| Requirement for Senior Data Engineer in Jersey City, NJ at Jersey City, New Jersey, USA |
| Email: [email protected] |
| Thanks & Regards Jai | Bench Sales Recruiter IT RESOURCES INC Certified Minority & Women Business Enterprise (MBE & WBE) E : [email protected] | T : 4153669590, 4153669590 X 107 Linkedln: https://www.linkedin.com/in/jai-prakash-a6a033147/ www.it-resinc.com | 220 Continental DR, #104 Newark, DE-19713 --------- Original Message --------- Subject: Requirement for Senior Data Engineer in Jersey City, NJ From: "Avnish Naagar" <[email protected]> Date: 1/11/24 1:20 pm To: "Avnish Naagar" <[email protected]> Role: Senior Data Engineer Location: Jersey City, NJ - Need Local or Nearby Duration: Long-term Mode of interview: Video Visa: Any Visa Will work Must have 10+ years profile. Must Have Banking or Investment Management 3+ Years. Must have Good Snowflake, and Market Data Job Overview: Building Pipelines Created over 200 pipelines encompassing: a. Market data functionality b. Integration of Bloomberg data feeds c. Processing ticket prices d. Ensuring clean investment ticket price data. e. Ensuring proper construction and functionality. Management of Market Data Handling thousands of line items daily Uploading and managing data within Snowflake Error Identification Identifying and addressing error conditions within tickets and records Ensuring 99.9% data accuracy and completeness Dealing with Pipeline Failures Recently built a Citrix pipeline to fulfill specific needs. Proficient in managing and understanding pipeline architecture. Requirement: Ability to construct pipelines effectively Data Integration Responsible for data integration processes Supports pipeline and manages cloud data warehouse (Snowflake) Snowflake Data Management Bringing various data sources into Snowflake Snowflake Data Share Facilitates the utilization of Snowflake data share, simplifying API endpoints. Sets up and manages data-sharing processes. Precan Folder Management Manages a live 'Precan' folder, presumably containing pre-defined or pre-processed data. Airflow Astronomer Works with Airflow Astronomer, likely for managing and orchestrating data workflows Data Engineering Responsibilities Provision of data pipelines Utilizing Fivetran for ELT processes with versatile connectivity Interaction with third-party administrators Pipeline Establishment and Connectivity Engineers responsible for setting up and maintaining pipelines. Capable of rearchitecting and optimizing pipelines Managing numerous pipeline requests across different teams Architectural Expertise Proficient in redesigning and constructing pipelines for efficiency. Collaboration and Availability Availability across different teams to address varied pipeline needs. Core Source of Data for the Team Tools: Snowflake, AWS, Azure, DBT, CI/CD, Jenkins, Python, Airflow Team Structure: Team Size: Currently comprises 5 individuals. Recent Changes: Experienced 2 departures; looking to backfill positions for maintaining operational capacity. Pipeline Management: Responsible for managing the production pipeline. Architectural Responsibilities: Some team members focus on architecting the pipeline structure. Warm Regards Avnish Naagar Email: [email protected] SGI Inc.. Address: 20130 Lakeview Center Plaza, Suite 400, Ashburn, Virginia 20147 -- -- Keywords: continuous integration continuous deployment information technology Delaware New Jersey |
| [email protected] View all |
| Fri Jan 12 03:52:00 UTC 2024 |
|
Attached files: Ram_Gadde 9+ Data Engineer_1705011753547.docx Shyam Prasad Moram_Data Engineer 15_1705011753695.docx Please check the file(s) for viruses. Files are checked manually and then available for download. |