| Urgent Requirement || Streamsets Data Engineer || Remote || 6+ Months at Remote, Remote, USA |
| Email: [email protected] |
| From: Suraj Prashar, Pivotal [email protected] Reply to: [email protected] Hi, Hope you are doing great!! Please find the requirement below, If you find yourself comfortable with the requirement please reply back with your updated resume and I will get back to you or I would really appreciate if you can give me a call back at my contact number (703) 570-8775 * (Ext. 232). Job Title: Streamsets Data Engineer Location: Remote Duration: 6+ MONTHS Visa Type: NO H1 Job Description:- The focus of this role is to assist in the utilization of the Full NextGen OSS Technology sack of Elasticsearch, Kubernetes, Kafka, StreamSets, Spark, Hadoop, Hive and Microservices developed in Java. Schedule & Work Location: Monday to Friday, 9:00 AM to 5:00 PM with occasional escalations. Primarily remote with quarterly onsite meetings in Downtown NYC and customer locations. Role Responsibilities: Collaborate as part of an agile team, attending daily stand-ups and Sprint planning. Proactively raise and address issues. Use reporting tools to monitor and adjust project progress. Address ad-hoc information requests promptly. Primary Technical Skills: Strong hands-on experience working on templatized, config driven, fragmented Streamsets pipelines. Comprehensive experience in the software lifecycle: from requirement analysis to deployment. Design and deployment skills for high-volume analytics systems and data pipelines. Proficiency in Big Data technologies like Kafka and Hadoop-based platforms. Expertise in managing concurrent access to resources to avoid race conditions and data inconsistencies. Hands-on experience with orchestration tools like Airflow. Hands-on experience working on highly scalable, highly concurrent and low latency systems Hands-on experience in event driven architecture design/solution using Kafka. Secondary Technical Skills: Experience with platforms like GitLab, Bitbucket. Familiarity with continuous integration, continuous delivery, and automation. Knowledge of event-driven architecture. Experience with Programming languages such as Scala, Java, Python. Hands-on experience with Spark framework and related tools (PySpark, Scala, Spark, Spark SQL, Spark UI) Experience working with Hybrid infrastructure. Soft Skills & Experience: Experience with an IT systems integrator in a customer-facing role. Ability to operate efficiently in a high-paced environment with limited supervision. Ability to motivate teams, manage multiple responsibilities, and strong interpersonal skills, including negotiation and collaboration. Team collaboration using version control systems. Keywords: user interface access management active directory information technology |
| [email protected] View all |
| Tue Aug 15 01:30:00 UTC 2023 |