| Senior Azure Data Engineer - Houston , TX || Chicago , IL || New Jersey , NJ at Houston, Texas, USA |
| Email: [email protected] |
| From: Maroju, Softcom [email protected] Reply to: [email protected] Role: Senior Azure Data Engineer Location: Houston , TX / Chicago , IL / New Jersey , NJ Job Description: View Creation and Optimization: Design and develop SQL Views to integrate data from various sources, such as transactional databases, data warehouses, and data lakes. Optimize Views for performance and ensure they meet business requirements. Data Modeling: Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and structure Views that support business intelligence, analytics, and operational needs. Data Source Integration: Work with data from multiple sources including relational databases like SQL Server, Oracle, etc., data warehouses, and data lakes (Azure Data Lake). Query Performance Tuning: Analyze and enhance SQL queries to improve performance, ensuring that Views are efficient, scalable, and align with best practices. Documentation: Document the structure and logic of Views, including table relationships, transformations, and dependencies, to support maintainability and knowledge sharing. Data Mapping: Try to establish the source and target data mappings, to ensure the support needed for building Data lineage and to support development of data transformation pipelines. Data Quality Assurance: Validate data consistency, accuracy, and completeness within Views and troubleshoot issues related to data integrity across sources. Collaboration: Work closely with data architects, data engineers, ETL developers, BI teams and Business Users to provide data accessibility while adhering to governance and data security policies. Required Qualifications: Experience: 10+ years as a SQL Developer, Data Engineer, or in a similar role focused on data integration and transformation. SQL Proficiency: Advanced knowledge of SQL and proven experience in writing complex queries, stored procedures, and Views. Data Source Familiarity: Experience working with various data platforms such as SQL Server, Oracle, and Azure Data Lake. Performance Tuning: Knowledge of query optimization and indexing strategies to enhance View performance. Data Integration: Familiarity with ETL/ELT processes, data pipelines, and tools for data integration, such as SSIS, ADF etc. Analytical Skills: Strong analytical and problem-solving skills with attention to detail in data quality and integrity. Communication: Ability to translate technical requirements into user-friendly, efficient Views and collaborate with cross-functional teams. Keywords: business intelligence Illinois New Jersey Texas Senior Azure Data Engineer - Houston , TX || Chicago , IL || New Jersey , NJ [email protected] |
| [email protected] View all |
| Thu Nov 21 04:44:00 UTC 2024 |