Kafka Engineer

We are looking for a skilled Kafka Engineer with hands-on experience in Confluent Platform to design, build, and maintain high-performance, real-time data streaming pipelines. The ideal candidate will have expertise in Kafka ecosystem components and be well-versed in deploying and scaling Kafka clusters, both on-prem and in cloud environments.

Key Responsibilities

• Design, build, and manage Kafka and Confluent infrastructure for high throughput streaming applications
• Implement Kafka Connect, Schema Registry, and KSQL (KSQLDB), FlinkSQL
• Ensure high availability, performance tuning, and monitoring of Kafka clusters
• Collaborate with data engineers and backend teams to integrate streaming pipelines with data lakes, warehouses.
• Set up and enforce Kafka security mechanisms (SASL, SSL, ACLs, RBAC)
• Create and manage CI/CD pipelines for Kafka components using tools like Git, Jenkins, etc.
• Monitor and troubleshoot issues using tools like Confluent Control Center, DataDog

Required Skills

• Experience in Apache Kafka and Confluent Platform
• Experience with Kafka Connect, Kafka Streams, Schema Registry, KSQL, and FlinkSQL
• Strong background in Java or Python
• Good understanding of stream processing and event-driven architecture
• Hands-on experience with cloud platforms: AWS / Azure / GCP (esp. Confluent Cloud)
• Proficient in Kafka cluster deployment, tuning, and maintenance
• Familiarity with CI/CD, Git, Helm, and Kubernetes

Nice to Have

• Knowledge of Terraform, Pulumi, or other Infra as Code tools
• Exposure to DataOps / Data Engineering ecosystems