Kafka Administrator

Job Description

Hiring for Kafka Administrator -- Hyderabad Job Summary: We are seeking an experienced Kafka Administrator to manage and maintain our Apache Kafka ecosystem. This role is critical in ensuring the high availability, performance, and security of our messaging and streaming platform used for real-time data pipelines and event-driven applications. Key Responsibilities: Install, configure, and manage Apache Kafka clusters in production and non-production environments. Monitor Kafka infrastructure using tools like Prometheus, Grafana, or Confluent Control Center. Perform upgrades, patching, tuning, and troubleshooting of Kafka brokers, ZooKeeper, Connect, and other ecosystem components. Implement security best practices, including SSL, SASL, and RBAC in Kafka. Ensure high availability and disaster recovery strategies for Kafka. Set up Kafka Connectors and Streams to integrate with external systems. Collaborate with application developers and data engineers to optimize Kafka usage. Automate routine tasks using shell scripts, Python, or Ansible. Maintain Kafka documentation including topology, policies, and configurations. Participate in on-call support rotation and incident response. Required Skills and Qualifications: Bachelors degree in Computer Science, Information Technology, or a related field. 4 years of hands-on experience with Kafka administration. Strong understanding of Kafka architecture, internals, and ecosystem tools (Kafka Connect, Kafka Streams, Schema Registry). Experience with Linux system administration. Familiarity with containerization (Docker, Kubernetes) and CI/CD pipelines. Experience with monitoring and alerting systems. Scripting experience (Bash, Python, etc.). Understanding of networking, security protocols, and access control in distributed systems.