Kafka Engineer
Debidutta DashUnited StatesMIDPosted 7d ago
Apache KafkaConfluent PlatformKafka clusterTerraformAnsiblePythonShell scriptingCI/CDPrometheusGrafanaTLSSASLACLsRBAC
About the Role
We are looking for a Kafka Engineer to join our team. This role focuses on administering Apache Kafka and Confluent Platform, with a focus on cluster setup, configuration, and performance tuning.
Key Responsibilities
• Administer Apache Kafka and Confluent Platform
• Set up, configure, and upgrade Kafka clusters
• Monitor Kafka performance and implement tuning strategies
• Manage Kafka topics, partitions, replication, and consumer lag
• Implement Kafka Connect, Schema Registry, and security protocols
• Utilize Terraform, Ansible, and scripting for automation
• Implement monitoring with Prometheus and Grafana
• Ensure disaster recovery and high availability
Requirements
• 5–8 years of relevant experience
• Strong hands-on experience with Apache Kafka and Confluent Platform
• Experience with Kafka cluster setup, configuration, and upgrades
• Knowledge of Kafka topics, partitions, replication, and troubleshooting
• Familiarity with Kafka Connect, Schema Registry, TLS, SASL, ACLs, and RBAC
• Proficiency in Terraform, Ansible, Python, and Shell scripting
• Experience with CI/CD, Prometheus, Grafana, and disaster recovery
• Must be available for 100% onsite work
• H1B candidates only