| Data Engineer at Chicago, Illinois, USA |
| Email: [email protected] |
| From: Abhishek singh Golden, Vyze Inc. [email protected] Reply to: [email protected] Job Description - Data Engineer Location: Chicago, IL (Hybrid)- Locals Only Duration: 6 months project Visa: No GC-EAD Client is seeking an experienced Data Engineer to contribute to a high data volume Electronic Records application. Volume of 10 million records , the team works with multiple such records This critical system not only requires ongoing production maintenance but also demands enhancements through integration with Machine Learning (ML) and Master Data applications. In the future, there's a plan to migrate the existing EMR application to AWS Glue. The ideal candidate will possess robust data engineering expertise, adept at designing, developing, and fine-tuning applications. Exposure to various design patterns within the data engineering paradigm is crucial for success in this role. Requirement Details AWS Cloud Technologies: This is must have for all candidates Apache Spark (3-5 years) AWS EMR proficiency (3-5 years) AWS Glue expertise (3+ years) Lambda , SNS , DynamoDB Strong PySpark Application Development: Extensive experience in designing, developing, troubleshooting, and debugging PySpark applications Proven track record in processing and handling large datasets Spark - Performance Tuning: Hands-on experience in performance tuning Spark applications Skills to optimize Spark code for scalability, performance, and maintainability Microservices Development : Proficient in developing microservices using AWS Lambda, SNS, DynamoDB (1-5 years) Code Management : Strong proficiency in using GitHub for efficient code management and sharing Nice to have not a must have : Experience in the node.js, vue.js. Experience in Databricks Regards, Headquarters : 25179 Methley Plum Place, Aldie, VA 20105 Abhishek Singh (Golden) Sr. IT Recruiter | IT Healthcare & Informatics Email: [email protected] Keywords: machine learning javascript information technology green card Illinois Virginia |
| [email protected] View all |
| Wed Jan 24 02:37:00 UTC 2024 |