| Data Engineer at Oakland, Oregon, USA |
| Email: [email protected] |
| From: David, Fluxtek solutions [email protected] Reply to: [email protected] Role: Data Engineer Location: Oakland or Rancho Cordova or Alpharetta(Remote) Duration: Long term Contract Rate; DOE Exp Level: 10+ years JOB SUMMARY The Senior Data Engineer will design, build, and implement data integration solutions, including data pipelines, data API's, and ETL jobs, to meet the data needs of applications, services, micro services, data assets, and business intelligence and analytical tools. Working with data architects, application development teams, data analytics teams, business analytics, product managers, and the data governance COE, the Senior Data Engineer will design and develop interfaces between applications, databases, data assets, external partners, and third-party systems in a combination of cloud and on-premise platforms. Matillion and Snowflake are the key requirements Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools Designs and develops data migrations in support of enterprise application and system implementations from legacy systems Writes functional specifications for data pipelines and APIs and writes and performs unit/integration tests Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Assists in planning, coordinating, and executing engineering projects Supports and collaborates with other Engineers through evaluation, design analysis, and development phases Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams This list is not all-inclusive and you are expected to perform other duties as requested or assigned ESSENTIAL DUTIES Develops and maintains scalable data pipelines and builds out new integrations to support continuing increases in data volume and complexity Designs and develops scalable ETL packages for point to point integration of data between source systems, extraction and integration of data into various data assets, including data warehouse and fit for purpose data repositories, both on prem and cloud Designs and develops scalable data APIs to provide data as a service to microservices, applications, and analytical tools Designs and develops data migrations in support of enterprise application and system implementations from legacy systems Writes functional specifications for data pipelines and APIs and writes and performs unit/integration tests Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues. Assists in planning, coordinating, and executing engineering projects Supports and collaborates with other Engineers through evaluation, design analysis, and development phases Maintains knowledge, ensures competency and compliance with policies and procedures, in order to be the technical expert while collaborating with cross-functional teams This list is not all-inclusive and you are expected to perform other duties as requested or assigned 5+ w/Bachelors degree Skills/Experience: Meet with the Product Owner to gather requirements Experience building ETL for analytical models Design and Develop Matillion orchestration jobs to integrate the data and Compare the results of the Data integration between the Source and Target Experience in implementing frame work solutions for data reconciliation Evaluate Results and discuss discrepancies with the Product Owner and Business and bring closure to the discrepancy Deploy code to Production Matillion and Snowflake are the key requirements Warm Regards David US IT Recruiting Fluxtek Solution Inc Email : [email protected] Keywords: information technology |
| [email protected] View all |
| Wed Feb 14 03:24:00 UTC 2024 |