| Need for Lead Data Engineer (Senior Platform Engineer) Chicago, IL (Onsite) at Chicago, Illinois, USA |
| Email: [email protected] |
| From: sivaji, Headway Tek Inc [email protected] Reply to: [email protected] Lead Data Engineer (Senior Platform Engineer) Chicago, IL (Onsite) Specialization AWS Data Engineering Basic: Lead Data Engineer with Spark/Scala + Java + Kafka + AWS Job requirements Bachelors in Computer Science, Engineering, or related technical discipline or equivalent combination of training and experience 10+ years programming experience: building application frameworks, and back-end systems for high-volume pipelines using Go/Java/Python. Python/Java preferred. 10+ years experience building data frameworks, platforms and scaling them to large volume of data using message brokers. Kafka experience is must. 5+ years experience building streaming platform using Apache Kafka, Confluent Kafka, AWS Managed Kafka Service. 5+ years experience ingesting data from SQL Server/My SQL/Oracle using Change Data Capture, debezium, and Kafka Connect. 2 years experience using AWS Data Services: any combination of DMS, EMR, Glue, Athena, S3, CloudWatch, Lambda or IAM 1-year exp. with data architecture, ETL and processing of structured and unstructured data 2 years experience with DevOps tools (any combination of GitHub, TravisCI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development) Keywords: sthree golang Illinois Need for Lead Data Engineer (Senior Platform Engineer) Chicago, IL (Onsite) [email protected] |
| [email protected] View all |
| Fri Nov 08 00:25:00 UTC 2024 |