| Required Data Engineer, Local to Minneapolis, Minnesota-- hybrid at Minneapolis, Minnesota, USA |
| Email: [email protected] |
| From: Bhavya Nikhil, KPG99 Inc. [email protected] Reply to: [email protected] Hi, Hope you are doing well. Please find the Job description below and let me know your interest. Position : Data Engineer Location : Local to Minneapolis, Minnesota-- hybrid Duration : 3+ month contracts Mode of interview : Video Job description : REQUIRED SKILLS Resource will be responsible for developing UI components in React and coordinating closely with Business partners to create efficient and effective UI for end users. 7+ years experience in React UI Development Excellent communication, verbal, written, etc need to be able to discuss with business partners and technical teams Senior Software Engineer (Big Data - Spark) Primary Responsibilities: Azure, Spark, Kafka experience required Design and build highly available, scalable, resilient and fault tolerant distributed real-time data streaming system. Automate test coverage (90+%) for data pipelines, best practices and frameworks for unit, functional and integration tests. Automate CI and deployment processes and best practices for the production data pipelines. Build AI/ML model based alert mechanism and anomaly detection system for the product. The goal is have a self-annealing product. Basic Qualifications Bachelors degree or equivalent work experience. 5+ years of relevant experience. Preferred Skills/Experience 10+ years of overall experience in software development with 5-6 years of relevant experience in designing, developing, deploying and operating data streaming pipelines at scale. 3-4 years experience with Apache Kafka and Apache Spark Streaming Hands on experience with Spark Structured Streaming Experience in tuning Spark Data pipeline to achieve high throughput. Drive efforts to improve the data quality across data pipelines and implement system controls for managing data quality Programming proficiency in Scala or Java. Open Source Committer (Apache Spark or related Big Data open source technologies) Experience with Containers, Kubernetes and scaling elastically Strong background in algorithms and data structures and continuously develop and acquire new technical skills Lead and mentor junior engineers to ensure systems are built with highest quality and leveraging best practices. Experience in automating Spark pipeline deployment/testing (DevOps, CI/CD) Passion for data engineering and for enabling others by making the product easier to use. Excellent communication in sharing context to effectively collaborate with analytical partners, domain experts and other consumers of your work, preferably in supporting an engineering or product function Required Skills Summary: Apache Spark, Apache Kafka, Scala/Java, NoSQL Databases, Elasticsearch & Kibana, Kubernetes, Docker Containers NOTE: - IF I MISSED YOUR CALL EMAIL IS THE BEST WAY TO REACH ME Bhavya Nikhil I Technical Recruiter I KPG99 Inc. Direct (609-236-2769) I [email protected] LinkedIn : https://www.linkedin.com/in/bhavya-nikhil-kujur-418511149/ htt:// www.kpg99.com/ 3240 E State St EXT, Hamilton, Nj 08619 Keywords: continuous integration continuous deployment artificial intelligence machine learning user interface New Jersey Required Data Engineer, Local to Minneapolis, Minnesota-- hybrid [email protected] |
| [email protected] View all |
| Tue Aug 06 00:54:00 UTC 2024 |