Lead Data Engineer - Baskin Ridge, NJ, Irving, TX, Ashburn, VA-hybrid-C2C at Ridge, New York, USA |
Email: [email protected] |
From: sudharsan.s, Vysystems [email protected] Reply to: [email protected] Job Responsibilities: As the Data Engineer lead, you are expected to engineer, develop, support, and deliver real-time streaming applications that model real-world network entities, and have a good understanding of the Telecom Network KPIs to improve the customer experience through automation of operational network data. Real-time application development will include building stateful in-memory backends, real-time streaming APIs , leveraging real-time databases such as Apache Druid. Architecting and creating the streaming data pipelines that will enrich the data and support the use cases for telecom networks. Collaborating closely with multiple stakeholders, gathering requirements and seeking iterative feedback on recently delivered application features. Participating in peer review sessions to provide teammates with code review as well as architectural and design feedback. Composing detailed low-level design documentation, call flows, and architecture diagrams for the solutions you build. Running to a crisis anytime the Operations team needs help. Perform duties with minimum supervision and participate in cross-functional projects as scheduled. Skills: Experience with Java, K8S, Flink/Spark, Argo CD/Workflow, Prometheus, and Aether. Familiarity with object-oriented design patterns. Experience with Application Development DevOps Tools. Experience with distributed cloud-native application design deployed on Kubernetes platforms. Experience with PostGres, Druid, and Oracle databases. Experience with Messaging Bus - Kafka/Pulsar Experience with AI/ML - Kubeflow, JupyterHub Experience with building real-time applications which leverage streaming data. Experience with streaming message bus platforming, either Kafka or Pulsar. Experience with Apache Spark applications and Hadoop platforms. Strong problem-solving skills. Strong written and oral communication skills. Keywords: continuous deployment artificial intelligence machine learning |
[email protected] View all |
Wed Aug 16 23:11:00 UTC 2023 |