| Urgent Required Lead Data Engineer Location: Dallas, TX (Onsite) at Dallas, Texas, USA |
| Email: [email protected] |
| From: Sarvan Kumar, Rivago infotech [email protected] Reply to: [email protected] Job title: Lead Data Engineer Location: Dallas, TX (Onsite) Duration: Long term Qualifications: 15+ years of experience in ETL & Data Warehousing Should have excellent leadership & communication skills Should have in depth knowledge on SSIS ETL Tool and good working knowledge on Power BI Should have worked on data sources such as SAP and Salesforce Should have very good knowledge of SSIS (ETL Tool), StreamSets (ETL Tool), Azure Cloud, ADF, Azure Synapse Analytics & Azure Hub Events Should have executed atleast 2 Azure Cloud Data Warehousing projects Should have worked atleast 4 projects using Agile/SAFe methodology Should have demonstrated working knowledge on ITIL V4 concepts such as Incident Management, Problem Management, Change Management & Knowledge Management Should have working experience on any DevOps tools like GitHub, Jenkins, etc & on semi-structured data formats like JSON, Parquet and/or XML files & written complex SQL queries for data analysis and extraction. Should have in depth understanding on Data Warehousing, Data Analysis, Data Profiling, Data Quality & Data Mapping Should have cross global location experience and led a team of atleast 15+ members in a global delivery model Should have experience in working with product managers, project managers, business users, applications development team members, DBA teams and Data Governance team on a daily basis to analyze requirements, design, development and deployment technical solutions Responsibilities: Lead nearshore and offshore team to do production support of existing EDW, design, build & deploy enhancements and bug fixes to existing EDW Support the existing EDW system built using Azure SQL, Microsoft SSIS, StreamSets & Power BI Be on call to support job incidents on rotational basis Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations Leverage ITIL concepts to circumvent incidents, manage problems and document knowledge Analyze the different source systems, profile data, understand, document & fix Data Quality issues Gather requirements and business process knowledge in order to transform the data in a way that is geared towards the needs of end users Write complex SQLs to extract & format source data for ETL/data pipeline Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration Design, Develop and Test ETL/Data pipelines Write Unit Test cases, execute Unit Testing and document Unit Test results Deploy ETL/Data pipelines Use DevOps tools to version, push/pull code and deploy across environments Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other adhoc requests Maintain and improve already existing processes Ensure that the data pipelines are stable, secure, maintainable and highly available Keywords: business intelligence Texas |
| [email protected] View all |
| Fri Dec 15 22:37:00 UTC 2023 |