| Urgent hiring -Data Engineer (SQL Replication + data bricks SME abilities)-Must be local in Dallas for onsite weekly one day each week at Dallas, Texas, USA |
| Email: [email protected] |
| From: Sradha Suman Nayak, Adventa tech [email protected] Reply to: [email protected] Title: Data Engineer (SQL Replication + data bricks SME abilities) Location: Must be local in Dallas for onsite weekly one day each week Duration: 6-12 months Visa: CITIZEN,GREEN CARD Moi: Skype NOTE: comm skills MUST BE amazing! These are notes from our internal DE that interviewed. He has no hands on replication experience so they are passing on him. DBA - These could also go in DE, but seem a little more DBA in their instance; These were the 2 check boxes I couldn't pass SQL Server Replication - This was an absolute must Code refactoring - Wanted to make the code more efficient DE Python Databricks SQL Developer - Specifically SQL server, but they are all the same Understanding of legacy code Cloud services: Someone with experience in Azure or another cloud service Others Verbal and written communication Good documentation skills - They want that legacy code documented thoroughly Challenge We have data processing system that is being modernized. The first part of the system is modern, using Databricks as a high speed ETL engine. The second part is legacy, using Microsoft SQL Server Replication to distribute data. The challenge is that the legacy part of the system cannot keep up with volume and velocity of the data produced by the modern part and will severely bog down, impacting our customers who rely on this data. We have had customer impacting events at least once per month since March. We know there are techniques to mitigate this but there are no experts in SQL Server or replication available internally. Additionally, we do not have a technical SME who can explain the legacy code. What we need We need an expert who has a depth of hands-on experience using Microsoft SQL Server (9+ years) and who is particularly experienced in using replication. This person would be very skilled in SQL, and able to interpret/extrapolate business logic from SQL code. Additionally, they should know end-to-end data processing techniques and have modern data processing experience using Python and/or Spark 6+yrs). Databricks(3+yrs) experience. The person should have good experience in data integration and working in cloud (Azure preferably). Success criteria At the end of the engagement, we will have a more resilient SQL Server Replication operations with a measurable reduction of customer impacting events resulting from SQL Server Replication. We will have documentation of what the legacy code does and the changes that were made to strengthen the process. This should include any technical debt incurred due to the speed of implementation we require. For quick interview and submission, please email me ALL of the following details: First and Last name as it appears on your passport: REQUIRED: What sets you apart from your competition/anything we should know about you for presentation as it relates to this position: Why you are looking for a change: Communication skills/C-Level interaction (1-10): Leadership skills/presence (1-10): Hourly rate, all-inclusive (1099 or C2C only at this time): US Work Status: Resume in MS Word: Education and certs - degree, year, university: Availability to start (remote, w onsite each Tuesday): Email and phone number: LinkedIn Profile: Are you TEAMS/video interview ready: Current location (city and state): Keywords: cprogramm information technology golang microsoft Delaware Urgent hiring -Data Engineer (SQL Replication + data bricks SME abilities)-Must be local in Dallas for onsite weekly one day each week [email protected] |
| [email protected] View all |
| Wed Aug 21 04:41:00 UTC 2024 |