| Lead Data Engineer III at Houston, Texas, USA |
| Email: [email protected] |
| From: Sanjeev Kumar Singh, Tek Inspirations LLC [email protected] Reply to: [email protected] Job Description - Job Description - Title: Lead Data Engineer III Location: Houston, TX (100% Onsite) Must be a local candidate living in the Greater Houston area. Duration: 6+ months Visa: USC, GC, H4EAD Job Description We are currently seeking an experienced Data Engineer to join the Big Data and Advanced Analytics department. The Data Engineer will work closely with business domain experts to create an Enterprise Data Lakehouse to support data analytic use cases for midstream oil and gas business units. This individual will provide analytical and technical leadership to the team to advance the data engineering practice within the organization. Responsibilities include: Design and implement reliable data pipelines to integrate disparate data sources into a single Data Lakehouse Design and implement data quality pipelines to ensure data correctness and building trusted datasets Design and implement a Data Lakehouse solution which accurately reflects business operations Develop and maintain reusable data building blocks Assist with data platform performance tuning and physical data model support including partitioning and compaction Provide guidance in data visualizations and reporting efforts to ensure solutions are aligned to business objectives Qualifications: 10+ years of experience as a Data Engineer designing and maintaining data pipeline architectures. 7+ years of programming experience in Python, ANSI SQL, PLSQL, and TSQL. 5+ years implementation experience on modern data stack technologies including cloud data warehouses, data lakes, and data lakehouses. Experience with various data warehouse design methodologies including dimensional modelling, non-volatile, time-variant, function-centric, and unification-centric design. Experience in cleansing, curating, and organizing complex datasets and data sources. Experience in software development practices such as Design Principles and Patterns, Testing, Refactoring, CI/CD, and version control. Knowledgeable of modern data platform technologies including Apache Airflow, Kubernetes, and S3 Object Storage. Experience with Dremio, DBT, and Airbyte. Keywords: continuous integration continuous deployment sthree green card Texas |
| [email protected] View all |
| Fri Dec 22 01:46:00 UTC 2023 |