Jobs → Engineering → AWS Kafka Engineer

About the Role We are seeking an AWS Kafka Engineer to join our engineering team. This role involves supporting Kafka infrastructure, designing and deploying Confluent Platform components, and automating Kafka infrastructure deployments. Key Responsibilities • Support the Kafka Engineering Team in onboarding applications, connectors, producers, consumers, and streaming workloads through automated CI/CD pipelines • Design, deploy, administer, and maintain Confluent Platform components including Kafka Brokers, KRaft Controllers, Schema Registry, Kafka Connect, Control Center • Develop and automate Kafka infrastructure deployments using Ansible, Terraform, Jenkins, Git repositories, and Infrastructure-as-Code frameworks • Implement and support Kafka services on OpenShift, Kubernetes, cloud, and hybrid environments • Assist application teams in troubleshooting Kafka connectivity, performance, messaging, schema, and integration issues • Configure and support Kafka Connect source and sink connectors, data pipelines, and platform integrations • Implement and maintain RBAC, ACLs, SSL/TLS, mTLS, encryption, certificate management, and security controls • Perform lifecycle management of SSL/TLS certificates including provisioning, rotation, renewal, auditing, and revocation • Design and validate Disaster Recovery (DR), Cluster Linking, replication, failover, and resilience solutions Requirements • Experience with Kafka cluster deployment, upgrades, migrations, and multi-region implementations • Linux/Unix administration and performance tuning • Enterprise security, SSL/TLS, mTLS, RBAC, ACLs, and certificate lifecycle management • Monitoring and Observability: Dynatrace, Splunk, Prometheus, Grafana, Confluent Control Center • Disaster Recovery, Cluster Linking, Replication, and High Availability architectures • AI-assisted development tools such as Microsoft Copilot, Amazon Kiro and AI-powered DevOps automation platforms • Expertise in Kubernetes Operators, Custom Resource Definitions (CRDs), StatefulSets, and containerized Kafka workloads • Experience with GitOps and CI/CD-driven Kafka Connect deployments using CFK, Ansible, Jenkins, bitbucket • Knowledge of Kafka Connect plugin management, connector scaling, fault tolerance, and high availability