| Local to Dallas, TX : Data Engineer (SQL Replication + data bricks SME abilities) at Dallas, Texas, USA |
| Email: [email protected] |
| Title: Data Engineer (SQL Replication + data bricks SME abilities) Must be local in Dallas for onsite weekly one day each week Duration: 6-12 months Rate is 65/hr., all-inclusive Minimum 10+ Yrs exp required Must be local to Dallas who will work onsite 1 day per week (on Tuesdays- they go in Tues and Weds and we ask our guys to go in each Tuesday). Challenge We have data processing system that is being modernized. The first part of the system is modern, using Databricks as a high speed ETL engine. The second part is legacy, using Microsoft SQL Server Replication to distribute data. The challenge is that the legacy part of the system cannot keep up with volume and velocity of the data produced by the modern part and will severely bog down, impacting our customers who rely on this data. We have had customer impacting events at least once per month since March. We know there are techniques to mitigate this but there are no experts in SQL Server or replication available internally. Additionally, we do not have a technical SME who can explain the legacy code. What we need We need an expert who has a depth of hands-on experience using Microsoft SQL Server (9+ years) and who is particularly experienced in using replication. This person would be very skilled in SQL, and able to interpret/extrapolate business logic from SQL code. Additionally, they should know end-to-end data processing techniques and have modern data processing experience using Python and/or Spark 6+yrs). Databricks(3+yrs) experience. The person should have good experience in data integration and working in cloud (Azure preferably). Success criteria At the end of the engagement, we will have a more resilient SQL Server Replication operations with a measurable reduction of customer impacting events resulting from SQL Server Replication. We will have documentation of what the legacy code does and the changes that were made to strengthen the process. This should include any technical debt incurred due to the speed of implementation we require. We can submit one more candidate and they must be incredible personality and comm skills, etc. These are notes from our internal DE that interviewed. He has no hands on replication experience so they are passing on him. DBA - These could also go in DE, but seem a little more DBA in their instance; These were the 2 check boxes I couldn't pass SQL Server Replication - This was an absolute must Code refactoring - Wanted to make the code more efficient DE Python Databricks SQL Developer - Specifically SQL server, but they are all the same Understanding of legacy code Cloud services Someone with experience in Azure or another cloud service Others Verbal and written communication Good documentation skills - They want that legacy code documented thoroughly Thanks and Regards Vinod Kumar ST Global LLC Fax: 206-319-4579 [email protected] www.stglobaltech.com Note: We respect your Online Privacy. This is not an unsolicited mail. Under Bills.1618 Title III passed by the 105th U.S. Congress this mail cannot be considered Spam as long as we include Contact information and a method to be removed from our mailing list. If you are not interested in receiving our e-mails then please reply with a "REMOVE" in the subject line at mention all the e-mail addresses to be removed with any e-mail addresses, which might be diverting the e-mails to you. We are sorry for the inconvenience. -- Keywords: information technology golang Delaware Local to Dallas, TX : Data Engineer (SQL Replication + data bricks SME abilities) [email protected] |
| [email protected] View all |
| Tue Aug 20 02:06:00 UTC 2024 |