| Senior Data Engineer at Irving, Texas, USA |
| Email: [email protected] |
| From: Shyam, TechStar Group [email protected] Reply to: [email protected] Senior Data Engineer Location: Irving TX (Need local who can go to office Hybrid) JD: Analyze and understand data sources & APIs Design and Develop methods to connect & collect data from different data sources Design and Develop methods to filter/cleanse the data Design and Develop SQL , Hive queries, APIs to extract data from the store Work closely with data Scientists to ensure the source data is aggregated and cleansed Work with product managers to understand the business objectives Work with cloud and data architects to define robust architecture in cloud setup pipelines and work flows Work with DevOps to build automated data pipelines The candidate should have performed client facing roles and possess excellent communication skills Business Domain knowledge: Finance & banking systems, Fraud, Payments Required Technical Skills Big Data-Hadoop, NoSQL, Hive, Apache Spark Python Java & REST GIT and Version Control Desirable Technical Skills Familiarity with HTTP and invoking web-APIs Exposure to machine learning engineering Exposure to NLP and text processing Experience with pipelines, job scheduling and workflow management Keywords: golang Texas |
| [email protected] View all |
| Fri Jan 27 18:12:00 UTC 2023 |