Data Engineer Lead(10+ years of experience)@Remote at Remote, Remote, USA |
Email: [email protected] |
Job: Data Engineer Lead Location: Remote Duration: C2C GC, USC only Top 3 Skills: GCP, Databricks, Python/SQL Only Lead Job details: What are the primary goals and deliverables expected from this project: Team will be part of the E2E Fresh domain. E2E Fresh is responsible for perishable products like produce, meat, seafood and dairy.Specifically, this team will be responsible for data related to refrigerated supply chain, or Cold Chain as we call it. Cold Chain data includes data from temperature sensors, purchase orders, warehousing, and transportation routing and location. The overall goal is to use this data increase freshness of food at the stores. * Ingestion pipelines for data from internal and external applications. * Curation and presentation of application data to internal consumers. * Join data from multiple systems to create Fresh Domain Data. * Investigate and mitigate data quality issues. The journey of data enabling E2E Fresh will usually follow a path of Analytics to discover improvement opportunities, Reporting to allow operations to target improvement, and Event (real-time) Data to participate in operations. A hypothetical example would be: * Analytics reveals that strawberries are frequently subjected to high temperatures in transit from distribution center to stores.Management knows they have a problem and assigns operations to investigate. * Reports are given to operations managers to help them investigate and try an operational change like a temp check when the truck leaves the yard. Reports allow them to monitor and evaluate the effectiveness of the change on strawberry freshness. * The changes might mitigate some instances but not all. Sotransportation and/or stores are given real time data. This will allow them to be alerted that a truck is en route to the store with a high temperature. They turn the truck around before it even hits the stores loading dock and a replacement order is processed. This saves employee time and speeds up the replenishment process, resulting in fresher strawberries in the store. What specific technical skills and tools should the candidates possess: * Extensive knowledge of data principles, patterns, processes, and practices * Databricks * SQL * Python * Google Cloud Platform (GCP) understanding (especially Dataflow, Pub/Sub, Composer) Team will have dedicated Product manager and be directly supported by scrum master, solution architect, and data architect. Warm Regards, Bhaskar kumar | Senior Recruiter 3S Business Corporation [email protected] 16700 HOUSE HAHL RD BLDG 6B, Cypress, TX-77433 An E-Verified Company To be removed from our mailing list reply with " [email protected] " and include your "original email address/addresses" in the subject heading. Include complete address/addresses and/or domain to be removed. We will immediately update it accordingly. We apologize for the inconvenience if any caused. Please consider the environment before printing this email. Go Green -- Keywords: information technology golang green card Texas Data Engineer Lead(10+ years of experience)@Remote [email protected] |
[email protected] View all |
Thu Jun 27 00:28:00 UTC 2024 |