Home

Ramu thota - Data Engineer

[email protected]

Location: Irving, Texas, USA

Relocation: yes

Visa: h1b

Ramu Thota PROFESSIONAL SUMMARY: Over 13+ Years of experience with ETL Integrations using ADF, Snap Logic, Snowflake, ODS, Cloud, AWS/Azure, MSBI (SSIS, SSAS, SSRS), MS SQL Server, Power Shell, PostgreSQL, Power bi as a Senior/Lead in financial, insurance, health care and retail companies Capacious experience in writing T-SQL queries using DDL and DML commands to design and create Objects, Functions, Stored procedures and Views for developing DataMart/Data Warehouse/Reports. Worked on technologies like Master Data Services, Power BI, Power Pivot, EXCEL, SSRS Technologies and Microsoft SharePoint for developing reports using BI suite. Have commercial Lending experience Highly experienced in constructing CTE S, TEMP Tables, Constraints, and effective DDL/DML triggers for the database Integrity. Experience implementing Snow pipes, CDC, Snow SQL, performance tuning, monitoring, etc as part of Snowflake implementations Expert in Data Extraction, Transforming and Loading (ETL) using various tools such as SQL Server Integration Services (SSIS), Bulk Insert and BCP. Experience working with SSIS packages with proper implementation of Event Handlers, Loggings, Checkpoints, Package Configurations and Transactions. Good experience in Designing and Building the Cubes, by creating Dimensions and Fact Tables with Star Schema and Snowflake Schemas by using SQL Server Analysis Services (SSAS) in SSDT. Worked on MDX Queries, Calculated Members, Aggregations and KPI s after building Cubes in SSAS. Experience in report writing using SQL Server Reporting Services (SSRS) and creating various types of reports like drill down, Parameterized, Cascading, Conditional Table, Matrix, Chart and Sub Reports. Used various expressions to Calculate, Group, Filter, and Format the contents of a report. Involved in optimization of reports by using optimized data set, by implementing proper caching and Snapshot in report server. Implemented appropriate Scheduling to deliver reports to the end user in daily, weekly and monthly basis. Worked extensively on Power BI reports by developing maintaining and scheduling of reports. Experience in various Azure Cloud services related to data like HDInsight Clusters, Azure Data Factories for migrating data and Azure DW Experience in Big Data Technologies that involved creating Batch and Real-Time Processing by using technologies with Cosmos, Kusto, Scala, Hive, Kusto, Scope. Expert in understanding quickly, communication effectively and maintaining documents according to the Business needs. Technical Skills: Big Data Tools Hive, Cosmos, Hadoop, Kusto, scope Cloud Services Azure Cloud Services- ADF(V1), ADF(V2), Blob Storage, HDInsight Clusters, Azure Data Services, VMs RDBMS MS SQL Server , Oracle and Postgres Db. BI Tools Colud Datawarehouse SSIS, SSAS, SSRS, Master Data Services, Power Pivot/View, Power BI Snowflake Programming Skills Front End T-SQL, C#, MDX, DAX, XMLA, Hive SSMS, SQL Server Development Tools (SSDT), Microsoft Visual Studio, MS OFFICE, TFS, Azure Data Explorer - Kusto. Data Modeling Tools Erwin, Microsoft Visio 2013/2010/2007 Operating System Windows Server 2012/2008R2/2008/2003. Version control Tools SVN, GIT, GITHUB Scripting Python, Power Shell Processes Agile-Scrum, Waterfall, Kanban Bug Tracking Tools Jira, ServiceNow PROFESSIONAL EXPERIENCE: Client: CBRE , Dallas,TX Feb 2019 Present Role: Technical Lead Responsibilities: Design and Development of Database(go_landing) , tables ,indexes, constraints as part of db architecture Design and Development of SSIS packages for Yardi backup and restore and Integrations Build the pipelines to copy data from source to destination using ADF Transforming data in Azure Data Factory with the ADF transformations Experience implementing Snowpipes, CDC, SnowSQL, performance tuning, monitoring etc Created ETL pipeline from teams and AWS S3 extract files and load data into the snowflake Mentor new team members for their career growth and technologies learning during intern phase. Monitoring prod jobs and issue fixes quickly with less or minimal delay in production jobs completion Troubleshooting data issues and identifying root causes of performance bottlenecks in SQL Server and PostgreSQL Created data pipelines and schedules in snap logic Created stored procedures, indexes, functions and views both SQL Server and Postgres. Created Power BI reports Jobs implementation in AWS Cloud Environment: ADF, Snowflake, Snap Logic, Python, SQL Server, SSIS(ETL) , Postgres , AWS, XIRA, GIT,Power BI Client: Microsoft Redmond, WA Jun 2018 Jan 2019 Role: Technical Lead Responsibilities: Design and Developed SSIS Packages and Integrations. Design Dimensional Model for Datawarehouse Created Stored Procedures for data transformation from source to destination Design and Developed Tabular Cubes Developed Power BI visualization reports using Power BI Desktop Created Calculated measures in DAX Job monitoring for production support and for successful runs. Issue Resolution for adhoc business requests Environment: SSIS 2016(ETL) Integrations, SSAS 2016, SQL Server 2016, T-SQL, Visual Studio 2017, MDS(MasterDataServices), PowerBI,DAX,Azure Data Factory Client: American Credit Acceptance Spartanburg, SC Mar 2016 Jun 2018 Role: Technical Lead Responsibilities: Created SSIS Packages for Conversion Enhancement of SSIS packages through initiative tickets using Jira Provide support in database architecture of the organization through database design, modeling and implementation Developed ASP.NET Web API services to return JSON and XML Format. Prepare invoice reports and manage offshore team Responsible for offshore delivery Created stored procedures Created Cubes Created Workflows, jobs in Informatica and MDM Job monitoring and scheduling the SSIS packages Agile/Scrum methodology implementation Environment: SSIS 2014, SQL Server 2014, T-SQL, Visual Studio 2015, TFS, Informatica, MDM, Microsoft Dynamics CRM, Jira,SSAS Client: Microsoft,Redmond,WA Feb 2014 Feb 2016 Role: Technical Lead Responsibilities Created SCOPE scripts for Videos in Office site Created SSIS Packages with c#.net Provide support in database architecture of the organization through database design, modeling and implementation. Created Tabular Cubes Created stored procedures, views, synonyms Job monitoring and scheduling the SSIS packages Lead/mentor the team to achieve the assigned tasks Created PowerShell Script Written Views, CTE Analysis of data and specification documents Created stored procedures for FSP service to get customized feed data (multiple tables) from feed store to FSP database Created Run books during the transition period Developed reports in Power BI Environment: Big Data (Cosmos), SSIS 2014, SQL Server 2014, Tabular Cubes,T-SQL, Visual Studio 2013, TFS, C#.net,MIST 2.0,Powershell,Azure Via Christi Health. Bangalore, Karnataka Nov 2012 Jan 2014 Role: Senior Database Engineer Responsibilities: Developed MapReduce programs to parse the raw data, populate staging tables and store the refined data in partitioned tables in the EDW. Created Hive queries that helped market analysts spot emerging trends by comparing fresh data with EDW reference tables and historical metrics. Enabled speedy reviews and first mover advantages by using Oozie to automate data loading into the Hadoop Distributed File System and PIG to pre-process the data. Provided design recommendations and thought leadership to sponsors/stakeholders that improved review processes and resolved technical problems Building and monitoring in the project has been done continuously with a CI Tools like Jenkins. Managed and reviewed Hadoop log files. Tested raw data and executed performance scripts. Shared responsibility for administration of Hadoop, Hive and Pig. Environment: MapReduce 1.x, Hive, Pig, Tableau AXIS CAPITAL. INDIA, SINGAPORE May 2010 Nov 2012 Role: Senior Database Engineer Responsibilities: Created Data Quality Packages for different Sources Worked on SSIS Packages for Claims. Created Data Quality reports for different Sources and Subject areas based on attributes, money at summary and money at detail. Created ODS Environment: SSIS 2008, SQL Server 2008 R2, SSRS 2008, Power pivot, Share point CITI BANK. Bangalore, Karnataka Sep 2008 Apr 2010 Role: Senior Database Engineer Responsibilities: Generated Reports using Cube Created reports using Report builder 2008 Worked on SSIS Packages Prepared Unit Test case Specification Good Knowledge on optimizing the reports, MDX queries.. Generated Reports using Cube Created reports using Report builder 2008 Worked on SSIS Packages Prepared Unit Test case Specification Good Knowledge on optimizing the reports, MDX queries.. Environment: SSIS2005,SSAS 2005,SSRS 2005 Asconi Corporation Bangalore, Karnataka Jun 2007 Aug 2008 Role: Senior Database Engineer Responsibilities: Development of packages according to the ETL specifications for the staging area & warehouse data loading using SQL Server Integration Services & SQL Server 2005.. Importing Source/Target tables from the respective databases by using Execute Package Task& using Control Tasks in SQL Server 2005 Integration services Worked on SSIS Packages Environment: SSIS2005, SSAS 2005, SSRS 2005 Insurance EDW Bangalore, Karnataka Sep 2006 May 2007 Role: Senior Database Engineer Responsibilities: Primarily responsible for developing applications in SSIS as per Business Rules and features of the tool. Importing Source/Target tables from the respective databases by using Execute Package Task using Control Tasks in SQL Server 2005 Integration services Environment: SSIS2005, ORACLE Education: Sri Krishnadevaraya University M.C.A-Master of Computer Applications Keywords: csharp continuous integration business intelligence sthree database microsoft South Carolina Texas Washington