| Kafka Administrator // NYC, NY OR Alpharetta, GA at NYC, New York, USA |
| Email: [email protected] |
| Job Title: Kafka Administrator with Python Location: NYC, NY / Alpharetta, GA (Day 1 onsite - All 5 days in office) Job Description: 8+ yrs of well-versed experience as Kafka Administrator Hands-on experience in creating Kafka Topics/brokers & setup Zookeeper instances. Know how to setup - scheduler as well as Realtime data ingestion (from source to sink) using Kafka connectors (supporting CRUD operations) Well-versed with streaming On-Premises Data for Cloud Analytics using Confluent Kafka Setup Confluent Schema Registry & optimization in Kafka deployments (viz. Throughput, Latency, durability & availability) Error handling & retry/replay of messages if upstream/downstream system fails (error topic/queue concept) Well-versed in deploying Kafka nodes as POD or Docker container on AKS/OpenShift managed Kubernetes platform(s) Kafka monitoring dashboard setup using tools like Grafana/Prometheus Well-versed in writing Python & Shell scripts to automate infrastructure provisioning on Kafka Develop Python scripts to facilitate data ingestion, transformation, and processing within the Confluent Kafka ecosystem. Write and optimize Python code for data ingestion from various sources into Kafka topics. Develop Python-based Kafka consumers and producers to enable efficient data processing. Create and manage Kafka topics, producers, consumers, and schemas as needed using Python/Shell scripting. Monitor and fine-tune Kafka cluster configurations to optimize performance and resource utilization. Implementation understanding on access controls and authorization (like SASL, JaaS config, Kerberos, OAuth) mechanisms to protect Kafka Infra Understanding of Confluent Kafka Architecture & components Brokers, Schema Registry, Zookeeper, Producer, Consumers, Shared Clusters, Cluster linking, Mirror-Making etc. -- Keywords: information technology Georgia New York |
| [email protected] View all |
| Mon Nov 06 19:21:00 UTC 2023 |