| Need 11+ Lead Databricks Engineer with (Financial background is must) @ NYC, NY OR Iselin, NJ (Hybrid) at Iselin, New Jersey, USA |
| Email: [email protected] |
| Hi Greetings from Canopy One Solutions, Please go through below requirement if you are comfortable, please share your updated resume to my email id: [email protected] Position: Lead Databricks Engineer with (Financial background is must) Location : NYC, NY OR Iselin, NJ (Hybrid 3 days work from office) Experience:11+ must Note: Passport Number and Linkedin ID are Mandatory Major Responsibilities: Work on Finance data related to Collaterals, ETD, OTD, Settlement market, Cash product, Repo, Duos repo Design, develop, and deploy Databricks jobs to process and analyze large volumes of data. Collaborate with data engineers and data scientists to understand data requirements and implement appropriate data processing pipelines. Optimize Databricks jobs for performance and scalability to handle big data workloads. Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks. Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions. Demonstrated proficiency with Data Analytics, Data Insights Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process Azure Synapse/Bigquery/Redshift is good to have. Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards. Skills: 5+ years Strong experience in Finance / Banking industry Capital markets, investment banking - Collaterals, ETD, OTD, Settlement market, Cash product, Repo, Duos repo 10+ years - Enterprise Data Management 10+ years - SQL Server based development of large datasets 5+ years with Data Warehouse Architecture, hands-on experience with Databricks platform. Extensive experience in PySpark coding. Azure Synapse/Bigquery/Redshift experience is good to have 3+ years Python(numpy, pandas) coding experience Experience with Snowflake utilities such as SnowSQL and SnowPipe - good to have Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling. Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills Capable of discussing enterprise level services independent of technology stack Experience with Cloud based data architectures, messaging, and analytics Superior communication skills Cloud certification(s) Any experience with Regulatory Reporting is a Plus Education Minimally a BA degree within an engineering and/or computer science discipline Masters degree strongly preferred Required Details Full Name of the candidate Current Location (state) Month/Year of Passing (Graduation or Highest degree/Masters) Phone Email Id Overall Exp/Relevant Exp Rate: Availability to join Relocation (Yes or No) Immigration status: (Validity is mandatory) When did they travel to US: How many years in US on H1B: Did they travel to pursue Graduation or Masters: LinkedIn (MUST) Ravi Kumar Danda : https://www.linkedin.com/in/ravikumar-danda-89a1a523b/ Email: [email protected] Web:www.canopyone.com -- Keywords: business analyst information technology golang California Idaho New Jersey New York |
| [email protected] View all |
| Wed Jan 24 01:10:00 UTC 2024 |