Home

naresh - sr.data engineer/ETL developer

[email protected]

Location: Raleigh, North Carolina, USA

Relocation:

Visa: h1b

Shiva Shanker Srimalla : [email protected] : 346-375-0817 : Shiva S S | LinkedIn Summary Self-motivated Lead Developer with 14+ years of experience in system design, development, analysis, and implementation using Microsoft Technologies for enterprise level, cloud-native, Multitenant applications. experience in complete Software Development Life Cycle (SDLC) process in analysis, design, development, testing and maintenance of software. Expertise in designing and developing enterprise applications using Microsoft .NET, Azure, C#, SQL, ASP.NET, MVC Web API, REST, WCF, WPF, Angular and jQuery. Experience in Bug/Issue tracking tools like Bugzilla, JIRA. Knowledge of Software Development Life Cycle Methodologies Waterfall, and Agile Designed and built robust and scalable cloud-based enterprise integration solutions using Azure Integration Services, including Azure Functions, Azure Logic Apps, Azure Service Bus, and Azure APIM. Implemented secure authentication and authorization using Azure Entra ID, AD B2C, B2B, IAM, RBAC, Managed Identity, OAuth and Open Id Connect. Built ETL pipelines and Data Analytics solutions using Azure Data Factory, Data Lake Storage Gen2, Synapse Analytics. Experience in creating and managing the Azure managed services by writing Infrastructure as Code using ARM and Bicep templates. Proficiency in Azure event-driven, serverless application development using Azure Functions Experience with Azure portal administration and management Strong understanding of API governance principles and best practices Strong technical background in full stack application development with .NET Web API services, EF, Angular and WPF based desktop applications. Expertise in architecture patterns such as Microservices, Microkernel, Event driven, MVC, SOA, Client-Server, Layered, Clean Expertise in SOLID design principles, Dependency Injection, Repository, CQRS & MediatR, MVC, MVVM, Multithreading, Thread Pool, Event-based Asynchronous Hands on experience in building LLM based applications using Microsoft Semantic Kernel SDK, Azure OpenAI, and Azure Cognitive services. Experience in developing web pages in Responsive Design using Bootstrap and adapt to the changing environment. Spring Boot is used to create new modules and deploy the application in tomcat. Expertise in building LLM powered AI applications using Microsoft Semantic Kernel Plugins, Planners, Prompt engineering, kernel Memory, RAG, and vector embeddings. Knowledge on the Generative AI foundation Models like GPT 3.5, GPT 4, Text Embedding Hands on experience in Microsoft Bot Framework and developing Teams Bot applications using Azure cognitive services like QnAMaker and LUIS. Good understanding of applying Domain Driven Design (DDD) in Microservices architecture, CQRS with MediatR, Event Sourcing, Event Storming Experience in Writing MongoDB Schema using Mongos. Good experience on MongoDB scaling across data centers and/or in - depth understanding of MongoDB HA strategies, including replica sets. Experience in installing and maintaining MongoDB on cloud environments. Migrated Database from SQL Databases (Oracle and SQL Server) to NO SQL Databases (MONGODB) Experience in using Azure DevOps Scrum Boards, CI/CD Pipelines, YAML, Git Repos, Testing and Artifacts and Version Control Systems Git & TFVC Experience in ORM, Entity Framework Code First, Database First approaches, Linq2Db implemented the Features Security, Performance, CRUD operations and Migrations. Enhanced the performance of the application by constantly monitoring the queries by running Execution plans and query optimization techniques in SQL server. Proficiency in Data Structures like Linked Lists, Stacks, Queues, Trees, and expertise in algorithms like sorting and searching. Extensive working experience in unit testing framework xUnit, NUNIT, MOQ framework and well versed with TDD and automated testing. Proficiency in Software Development Life Cycle (SDLC) and AGILE (SCRUM) methodologies of development process such as requirement analysis & definition, prototyping, proof of concept, designing, coding, testing and implementation. Strong background in leadership, teamwork, interpersonal skills, business cases, planning and system designing. Hands on experience in C# AddIn development for the Autodesk software products like Revit and Civil 3D Experience in deploying, configuring, and maintaining web sites and services manually and using of Microsoft Web Deploy on IIS 7.0/6.0 Experience in Financial, Accounting, Automotive, Insurance, E-Commerce, Mortgage, Logistics, School Management System and Office Communications domains. Sound expertise in the assessment of operational performance& implementation of innovative ideas to enhance efficiency & effectiveness in operations of service delivery. Technical Skills Azure Expertise: API Management, App Service, Service Bus, Event Hub, Functions, Logic App, Key Vault, App Configuration, Entra ID, AD B2C, B2B, Monitor, Log Analytics, Workbooks, Blob Storage, Table, Files, SQL Database, Data Factory, Synapse Analytics, Cognitive Services, OpenAI Languages: C#, SQL, JavaScript, HTML, KQL, Bicep Frameworks & Technologies: ASP.NET, MVC, Web API, Angular, jQuery, WCF, WPF, .NET Core/Framework, LINQ, Entity Framework, Ef Core, xUnit, TDD, Microsoft Bot Framework, Spring Boot Database Technologies: SQL Server, MongoDB, Azure Cosmos DB, Ambari HDFS Development Tools: Visual Studio, Azure DevOps, Git, TFS, Jenkins AI Expertise: Azure OpenAI, Semantic Kernel, Kernel Memory, RAG, GPT 3.5/4, Text Embedding, Vector DB Certifications Having Certification in Azure DevOps: Designing and Implementing Microsoft DevOps Solutions. Having Certification in Microsoft Certified: DevOps Engineer Expert. Having Certification in Microsoft Certified: Azure Developer Associate. Education Bachelor of Technology (B. Tech) From JNTU University, 2009, Hyderabad Work Experience Client: Caliber Home Loans/Coppell, TX March 2024 Till Date Role: Lead Full Stack Developer Involved in Agile Scrum, participated in Requirements gathering, design, development, maintenance of software. Designed and implemented cloud-native, scalable responsive web application using Azure, Clean Architecture, MedaitR, CQRS, AutoMapper and MDB Created Azure Service Bus Queues and Function Apps to generate several documents during the loan application process and process the customer orders Created a frontend Applications Using Angular 14 Designed and developed Microservices using Spring Boot Framework using Maven framework to Home Loans System Application Using these services. Worked on the Azure Cognitive Search service to filter and provide the vehicle data based on the user searches Worked on the Loan Servicing Scorecard Metrics which is a Big Data Analytics project. Used Azure Data Factory for data ingestion, Databricks and SQL for data processing and transforming, Data Lake Storage Gen2, Synapse Analytics and PowerBI for reporting Created ADF pipelines to ingest data from csv files into the Data Lake Gen2 storage and finally into the Datawarehouse tables Created sql queries on the SQL Server Datawarehouse tables and generated PowerBI reports Implemented logging using Jwt Token and Azure Application Insights as the sink in production and File in the dev/qa environments Involved in theDevelopmentandTestingphases ofSDLC. Integrated GIT into Jenkins to automate the code check-out proces Implemented session management using Azure Cache for Redis. Implemented the auto renewal of the session with a prompt. Created and worked on the app services and service plans and configured scale in/out and scale up based on the requirements Created and managed the deployment slots in the app services for Stage, Production and Last good environments maintenance and swapping Created and managed the blob storage services for the document storage and management Created and managed the Azure CDN service for content management and delivery Utilized Bootstrap CSS framework for the responsive display, cross browser functionality and for multiple devices compatibility. Created and managed the CI/CD pipelines using Azure DevOps Involved in and monitored the performance testing reports of the application using the JMeter Created Unit test cases and Integration test cases using Visual Studio testing framework Environment: .NET Core 2, Azure, ASP.NET MVC 4, Razor, MDB, Web API 2, C# 4.5, Entity Framework, Open API, Swagger, Clean architecture, Repository, SQL Server, SQL, Visual Studio 2019, Azure DevOps, Git, Scrum, Angular 14, Spring Boot Client: ABSA Bank/Johannesburg, South Africa Feb 2022 March 2024 Role: Enterprise .NET Azure Architect/Lead Developer Lead and manage a team of software engineers, provide technical direction and guidance for development project. Oversee technical plans and time lines, ensuring projects are completed on time and on budget. Work closely with other departments, such as product management, cusomter support and marketing to ensure all requirementare met Provide technical expertise and guidance to ensure quality standards are met Research, evaluate and recommend new technologies., processes and tools to enhance development capabilities. Analyze customer requirements and develop technical solutions to meet cus tomer needs. Develop and document technical processes and procedures. Implement the best practices and metrics for a robust and sustainable codebase. Worked on a micro-services architecture-based Enterprise Integration project, Middleware that unifies the data flow between 2 enterprises Commission Management & PRI system. Involved in designing and implementing the part of the Middleware, Advisor using Azure and .Net 6. Designed, Implemented the Middleware Advisor considering all aspects of could-native applications: Resiliency, Availability, Maintainability, Observability and Scalability Built APIs using Azure API Management, Service Bus and Function App that are called by the Producer side of the Middleware to send data to the Advisor downstream systems like BOSS, SCPS and Common which are based on Sybase Databases. Expertise in setting up MongoDB clusters in Azure Environments. Experience in Installing, Administering, and Optimizing MongoDB instances. Created and managed Azure managed services like Key Vault, Blob storage, Tables, App Configuration, Monitor, Application Insights, Log Analytics Implemented API governance processes to manage API lifecycle, versioning, documentation, and security using Azure API Management Managed Azure portal configurations and permissions for development teams, optimizing usability and efficiency Implemented Service Bus triggers-based Azure Functions using C# & .Net 6. Created and handled the Alerts and linked to PagerDuty and MS Teams channel as notifications, integrated with Jira to create a Service Desk ticket when an alert is triggered using Azure Logic App. Integrated Azure services with Datadog, created Dashboards with Graphs that show various metrics including the consumer updates, success ratios, etc. Integrated Azure Function App with Datadog to send APM traces, Logs and created log search queries. Worked on copilot POC that is a Teams bot app that generates SQL, exports results to excel and sends the excel as an email attachment optionally for business users to view data using natural language queries using Azure OpenAI and Semantic Kernel SDK, GPT 4 and another copilot to answer business questions using Azure OpenAI on your Data. Created Datadog log metrics to be used in different Datadog graphs. Created Bicep templates to automate deployment of the Azure infrastructure used in Middleware consumer. Created KQL queries and Azure Workbooks on Azure Log Analytics to view and analyze the log data. Created Azure DevOps CI/CD Pipelines and handled deploying Azure Functions C# code to Azure Function App, Bicep templates to deploy Azure resources. Implemented sending email notifications using Graph API. Implemented SSIS Packages for Data Migration from one application product data to other application. Implemented UI interface for Commission Management System Using Angular 11 Designed and developed Microservices using Spring Boot Framework using Maven framework to Commission Management System Application Using these services. Environment: .NET 6, C# 11, Azure API Management, Service Bus, Functions, Logic Apps, Key Vault, App Configuration, Application Insights, Log Analytics, Workbooks, Monitoring, API Governance, Azure Portal, Entity Framework, SOA, Repository, Dependency Injection, xUnit, Visual Studio 2022, Azure, Datadog, Azure DevOps, Bicep, KQL, YAML, Git, Scrum, Cosmos DB, Azure OpenAI, GPT 4, Semantic Kernel SDK, Teams bot framework, GitHub Copilot, Angular 11, Spring Boot Client: MTN/Johannesburg, South Africa Jan 2020 Jan 2022 Role: Technical Lead - Engineering Involved in Release based software delivery approach and worked on Requirements gathering, Design, Development, Maintenance, phase of SDLC of Layered architecture.and Telecom domain experience Designed and Implemented cloud-native application, Created and Managed Azure WebApp, CDN, Active Directory, Blob Storage, Application Insights, SQL Managed Database. Created ARM templates for auto deployments of resources in Azure. Created and managed the deployment slots for Stage, Production and Last good deployment using swapping. Wrote and refactored for performance improvements of the SQL queries for customer loan reactivation/refinance approvals, payment processing, decision making, interest calculation Worked on adding new endpoints to the ASP.NET MVC Web API service, implemented Repository Pattern in DAL, used Entity Framework 6 for Database interactions, and used Dependency Injection to instantiate and inject the objects in several layers. Worked on Angular Web App, Created Components, Services, Routes, Logging, Consumed .NET Web API APIs, used Observables, and bound data to the UI controls Created and Managed services Azure Data Factory for data ingestion, Data Lake Storage Gen2, Synapse Analytics and PowerBI for reporting & analysis Designed and implemented the xml based precog scenario engine and WPF application to generate several scenario-based test data for Automation in testing Worked on BL and DAL layer classes and integrated in UI using MVVM pattern, used asynchronous programming extensively using async, await and Task Parallel Library Implemented API governance processes leveraging Postman tool for comprehensive testing, documentation, and monitoring of APIs, ensuring adherence to standards, and maximizing reliability. Designed and implemented several notifications and used Azure SendGrid service for email notifications, created html from template and sent in the email body. Implemented creating, storing, and sending of several loan related and customer personal documents using Aspose.PDF and Aspose.Words, Dependency Injection and RabbitMQ Queuing Protocol Designed and built the tools for aging of loans for testing purposes and worked on fixing several production bugs related to the Customer Portal and CSR application. Created a Microsoft Teams Bot using Microsoft Bot framework for customer support, loan origination and knowledge base. Created a customer support and knowledge bases bots using Azure cognitive services like QnAMaker and LUIS Worked on designing the bot to be a generic one for performing any type of action and provide any knowledge base using Azure LUIS and QnAMaker services Designed and developed Microservices using Spring Boot Framework using Maven framework to UI Application using these services. Environment: .NET Core 3, Azure, Bicep, ASP.NET MVC Web API, WPF, XAML, MVVM, WCF, C# 4.5, xUnit, Angular, SOA, Layered, API Governance, Entity Framework 6, Repository, Dependency Injection, Visual Studio 2019, RabbitMQ, SQL Server 2016, Azure DevOps, YAML, Git, Scrum, Spring Boot Client: Vertafore INC/Bothell, WA Aug 2013 Dec 2019 Role: Sr. Software Engineer Involved in Agile Scrum methodology by attending daily scrum Worked on the conversion of the WCF Services to OData Services of the Agency Management System back-end system Created a web-based test client to consume the OData service endpoints using AngularJS Worked on Run-Time Text Generation with T4 Text Templates for test case generation Worked on the data visualization and analytics tool, MyAgencyReports developed using AngularJS, ASP.NET Web API, SQL Server and MongoDB for the Vertafore products and the external products to generate reports. Worked on the data visualization and analytics tool, MyAgencyHome developed using Angular 2, ASP.NET Web API, SQL Server and MongoDB for the Vertafore products and the external products to generate reports. Worked on the Agency Management System, AMS360 developed using ASP.Net MVC, ASP.NET Web API, SQL Server and MongoDB for the Vertafore products and the external products to generate reports. Involved in designing the on-demand loading of the report data in the browser. Implemented the customizations in the AngularJS UI-grid control for the on-demand loading of data. Implemented core features of AngularJS framework such as dependency Injection, Data-binding, Filters, Directives, Templates, Services. Worked with AngularJS Http service to make backend Rest API calls. Created a mobile app using Ionic framework with Angular Implemented Sorting, Searching, Filtering of the report data on UI and API side. Worked on creating the Summary Views of the report data Created UI pages and designed elements as per the UX using HTML, CSS, JavaScript and jQuery. Converted CSS into SCSS for an improved organization of the stylesheets Worked on improving the query performance and reduce latency with the indexing in MongoDB Worked and configured MongoDB sharding, replica sets and load balancing Wrote MongoDB queries in JavaScript and programing in C# using MongoDB C# Driver. Created Unit test cases and Integration test cases using Visual Studio testing framework Worked on creating web-based responsive e--commerce single page application (SPA) using Angular 2, HTML5, CSS3 and Web API Environment: C#.NET 4.0/3.5, ASP.NET MVC, Web API 2, OData, WPF, WCF, CSLA, Log4Net, AngularJS 1.5, Angular 2, Ionic, MongoDB, HTML 5, CSS 3, SCSS, jQuery, LINQ, Entity Framework, ADO.NET, Visual Studio 2017/2015/2012, Azure DevOps, TFS Client: Advent Intermodal Solutions/New Jersey, NJ Feb 2012 Aug 2013 Role: Software Engineer Worked on classification of documents using pattern recognition model with the help of Regular Expressions and JavaScript Designed the application using SOA Daily Interaction with Clients on various status updates and requirements analysis. Created and consumed WCF Services to transfer the data among different layers and environments Developed Presentation layer (Web Forms) using jQuery, MVC, HTML and JavaScript. Provided the architectural solution to the application in case of major enhancements Implemented n-tier Layered architecture and generated Business Logic classes, Data Access classes and Data Domain Object classes, Middle Tier with WCF Service Used Telerik controls in the project Extensively used ASP.NET XML for dynamic insertion and deletion of the data Created Windows Service and SOAP based Web Service which interact through the Database when a request is made by the user Wrote SQL Server stored procedures, queries to insert/update/retrieve the Data Tree data using T-SQL Used AJAX and JSON to make asynchronous calls to the project server to fetch data on the fly. Conducted reviews on code optimization on regular basis right from the starting of the project Monitoring and tracking the project activities Participated in daily scrums and weekly meeting with the project sponsors to meet expectations and deadlines Environment: C#.NET 4.0/3.5/3.0, VC++, MFC, Win32 API, COM, ActiveX, ASP.NET Web Forms, SOAP Web Services, WCF Services, ADO.NET, SQL Server 2008, JavaScript, jQuery, Log4Net, Regular Expressions, Classification, HTML, CSS, Visual Studio 2012, TFS, VSS 6.0 Employer/Client: Techno Brain/Hyderabad, India Mar 2011 Jan 2012 Role: Software Engineer Built Web Conference application from scratch which is an online Human Resource Management and provides features like Recruitment module will deal with candidate application to final engagement in an organization Prepared Technical details design documents and involved in prototype designing Developed the UI (Web Forms) using ASP.Net Designed and implemented classes using OOPS concepts using ADO .Net Created and consumed WCF Services to transfer the data among different layers and environments Involved in Database Desing Wrote SQL Server stored procedures, queries to insert/update/retrieve the Data Tree data using T-SQL Extensively worked on creating complex data base objects Involved in discussions with Business users to get the requirements Involve in SDAL project, analysis and design Environment: C#, ASP.NET Web Forms, WCF Services, ADO.NET, SQL Server 2008, JavaScript, jQuery, HTML, CSS, Visual Studio 2010, TFS Employer/Client: DRS Group/Hyderabad, India Jan 2010 Feb 2011 Role: Software Engineer Gathering initial business requirements from the client and turning them to functional specifications Building the fully normalized database and generation stored procedures and views as per requirement Implemented 4 Layered architecture and generated Business Logic classes, Data Access classes, and Data Domain object classes Involved in designing and developing the code logic front end using ASP.Net website and admin control panel Extensively used ASP.NET XML control toolkit components for rich user interface in front end and admin panel websites. Implemented Asynchronous error handling mechanism for AJAX based web forms Designed and implemented classes using OOPS concepts using ADO .Net Created and consumed WCF Services to transfer the data among different layers and environments Wrote SQL Server stored procedures, queries to insert/update/retrieve the Data Tree data using T-SQL Implemented Crystal Reports Environment: MS SQL server 2005, ASP.NET Web Forms, WCF Services, ADO.NET, JavaScript, HTML, CSS, Visual Studio 2005, Crystal Reports, .Net Framework 2.0, TFS Keywords: csharp continuous integration continuous deployment quality analyst artificial intelligence user interface user experience database active directory microsoft Idaho New Jersey Texas Washington