| Data Engineer - Onsite in St Louis MO at St Louis, Missouri, USA |
| Email: [email protected] |
| Location: St Louis MO Duration: 8+ Months Primary Roles and Responsibilities: Developing Modern Data Warehouse solutions using Databricks and Azure Stack Ability to provide solutions that are forward-thinking in data engineering and analytics space Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in existing pipelines and fix the issues. Work with business to understand the need in reporting layer and develop data model to fulfil reporting needs Help joiner team members to onboard/mentor resolve issues and technical challenges. Ability to manage team technically and functionally. Drive technical discussion with client architect and team members. Orchestrate the data pipelines in scheduler via DBX Workflow/Airflow. Skills and Qualifications: Bachelor's and/or masters degree in computer science or equivalent experience. Must have total 8+ yrs. of IT experience and 5+ years' experience in Data warehouse/ETL projects. Deep understanding of Star and Snowflake dimensional modelling. Strong knowledge of Data Management principles Good understanding of Databricks Data platform and Databricks Delta Lake/Medallion Architecture Should have hands-on experience in SQL, Python and Spark (PySpark) Candidate must have experience in Azure stack Experience in building ETL / data warehouse transformation processes Experience working with structured and unstructured data. Experience working in a Dev/Ops environment with tools such as Terraform, GIT. Proficiency in RDBMS, complex SQL, performance tuning and troubleshoot. Databricks Certified Data Engineer Associate/Professional Certification (Desirable). Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects Should have experience working in Agile methodology (Jira/Azure Devops). -- Keywords: business intelligence information technology Missouri Data Engineer - Onsite in St Louis MO [email protected] |
| [email protected] View all |
| Fri Sep 13 00:38:00 UTC 2024 |