| Data Engineer only USC GC local to Michigan at Dearborn, Michigan, USA |
| Email: [email protected] |
| From: priyanka verma, Triwave Solutions Inc [email protected] Reply to: [email protected] Job Title: Data Engineer Location: Dearborn, MI can be remote also Duration: 12+ Months Only USC and GC Position Description: Were seeking a Data Engineer who has experience building data products on a cloud analytics platform. You will work on ingesting, transforming, and analyzing large datasets to support the Enterprise in the Data Factory on Google Cloud Platform (GCP). Experience with large scale solution and operationalization of data lakes, data warehouses, and analytics platforms on Google Cloud Platform or other cloud environments is a must. We are looking for candidates who have a broad set of technical skills across these areas. Skills Required: Experience in working in an implementation team from concept to operations, providing deep technical subject matter expertise for successful deployment. Implement methods for automation of all parts of the pipeline to minimize labor in development and production. Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple data sources to build analytical domains and reusable data products. Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, and consumption. Experience in working with stakeholders to formulate business problems as technical data requirements, identify and implement technical solutions while ensuring key business drivers are captured in collaboration with product management. Skills Preferred: Strong drive for results and ability to multi-task and work independently. Self-starter with proven innovation skills. Ability to communicate and work with cross-functional teams and all levels of management. Demonstrated commitment to quality and project timing. Demonstrated ability to document complex systems. Experience in creating and executing detailed test plans. Experience Required: 5+ years of SQL development experience 5+ years of analytics/data product development experience required. 3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale. Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow, Dataproc, Cloud Build, etc. Experience working with Airflow for scheduling and orchestration of data pipelines. Experience working with Terraform to provision Infrastructure as Code 2 + years professional development experience in Java or Python Experience Preferred: In-depth understanding of Googles product technology (or other cloud platform) and underlying architectures Experience working with DBT/Dataform. Experience with DataPlex or other data catalogs is preferred. Experience with development eco-system such as Tekton, Git, Jenkins for CI/CD pipelines. POSITION IS HYBRID: The candidate can be fully remote for the right person, but we will give preference to local SE MI candidates who can follow the mandated Ford Credit hybrid schedule of 3 days in the office. Keywords: continuous integration continuous deployment green card Michigan |
| [email protected] View all |
| Wed Feb 28 21:45:00 UTC 2024 |