| Data Engineer ; Remote. at Remote, Remote, USA |
| Email: [email protected] |
| From: Upama, CBS [email protected] Reply to: [email protected] Data Engineer ; Remote. Job Description We are looking for a skilled Data Engineer to join our data warehousing team in the supply chain domain. You will work closely with business stakeholders and analytics teams to design, build, and maintain big data solutions that enable advanced analytics. Responsibilities include: Design and develop optimized data models (e.g. star schema) to enable fast queries and easy reporting. Strong experience modeling data for analytical workloads required. Develop data pipelines to migrate data from various sources into data warehouses and data lakes. Experience with data formats like Parquet is essential. Implement data pipelines leveraging technologies like Azure Databricks, Azure Data Factory, Cosmos DB, and Azure Synapse Analytics. Hands-on experience with these technologies is required. Curate datasets to enable analytics use cases. Ability to understand business needs and prepare data to address them. Establish data governance practices, data quality standards, metadata management, and access control of warehoused data. Build processes supporting data transformation, data structures, metadata, dependency and workload management. Work with stakeholders to identify and fulfill new data and analytics requirements. Continuous improvement of data warehouse solutions. Key Responsibilities 5+ years experience as a Data Engineer working on large-scale data pipelines, ETL processes, and data warehousing Strong hands-on experience with big data tools like Spark, SQL, and Azure cloud technologies Experience building and optimizing star schema data models Excellent knowledge of data structures, data modeling, and data pipelines Experience with data formats like Parquet, JSON, Avro Experience establishing data governance practices and data quality standards BS/MS degree in Computer Science, Engineering or equivalent experience Keywords: database microsoft |
| [email protected] View all |
| Fri Sep 01 18:19:00 UTC 2023 |