| || urgent need Snr Data Engineer(12+ experience ) ||No H1b CPT || Hybrid in Jersey City, NJ || at Jersey City, New Jersey, USA |
| Email: [email protected] |
| From: Balram Kumar Singh, Spear Staffing LLC [email protected] Reply to: [email protected] Role-Snr Data Engineer(12+ experience ) Location: Jersey City, NJ Interview: 2 Steps Contract- C2C Client: Blackstone Interview Process: 2 Rounds Ideally: a Senior Data Engineer Banking or Investment Management Experience with Snowflake, and Market Data Knowledge. Tools: Snowflake, AWS, Azure, DBT, CI/CD, Jenkins, Python, Airflow Team Structure: Team Size: Currently comprises 5 individuals. Recent Changes: Experienced 2 departures; looking to backfill positions for maintaining operational capacity. Pipeline Management: Responsible for managing the production pipeline. Architectural Responsibilities: Some team members focus on architecting the pipeline structure. Job Overview: Building Pipelines Created over 200 pipelines encompassing: a. Market data functionality b. Integration of Bloomberg data feeds c. Processing ticket prices d. Ensuring clean investment ticket price data e. Ensuring proper construction and functionality. Management of Market Data Handling thousands of line items daily Uploading and managing data within Snowflake Error Identification Identifying and addressing error conditions within tickets and records Ensuring 99.9% data accuracy and completeness Dealing with Pipeline Failures Recently built a Citrix pipeline to fulfill specific needs. Proficient in managing and understanding pipeline architecture. Requirement: Ability to construct pipelines effectively Data Integration Responsible for data integration processes Supports pipeline and manages cloud data warehouse (Snowflake) Snowflake Data Management Bringing various data sources into Snowflake Snowflake Data Share Facilitates the utilization of Snowflake data share, simplifying API endpoints. Sets up and manages data sharing processes. Precan Folder Management Manages a live 'Precan' folder, presumably containing pre-defined or pre-processed data. Airflow Astronomer Works with Airflow Astronomer, likely for managing and orchestrating data workflows Data Engineering Responsibilities Provision of data pipelines Utilizing Fivetran for ELT processes with versatile connectivity Interaction with third-party administrators Pipeline Establishment and Connectivity Engineers responsible for setting up and maintaining pipelines. Capable of rearchitecting and optimizing pipelines Managing numerous pipeline requests across different teams Architectural Expertise Proficient in redesigning and constructing pipelines for efficiency. Collaboration and Availability Availability across different teams to address varied pipeline needs. Core Source of Data for the Team Thanks and regards Balram Kumar Singh Sr Technical Recruiter Phone:- 240-261-2375 Email:- [email protected] Website:- www.spearstaffing.com This message and any attachments are intended only for the use of the addressee and may contain information that is privileged and confidential. If the reader of the message is not the intended recipient or an authorized representative of the intended recipient, you are hereby notified that any dissemination of this communication is strictly prohibited. If you have received this communication in error, notify the sender immediately by return email and delete the message and any attachments from your system. Keywords: continuous integration continuous deployment New Jersey |
| [email protected] View all |
| Wed Jan 10 22:28:00 UTC 2024 |