Data Platform Engineer
Dhananjay H KUnited StatesSENIORPosted 4d ago
Apache KafkaKafka ConnectJavaApache FlinkFlink SQLAWSCDKMSKGlueS3SQLPython
About the Role
We are looking for an experienced Data Platform Engineer to build, optimize, and operate high-performance, near real-time streaming data platforms.
Key Responsibilities
• Design and maintain real-time streaming data pipelines using Apache Kafka and Kafka Connect
• Build and enhance CDC pipelines from operational databases and SaaS sources
• Develop stream processing solutions using Java, Apache Flink, and Flink SQL
• Implement cross-stream joins, data enrichment, and canonical data models
• Manage sensitive data governance, including PHI classification, access controls, and ABAC policies
• Provision AWS infrastructure using CDK, including MSK, Glue, and S3
• Establish CI/CD practices and ensure production reliability, latency, and throughput SLAs
• Collaborate with cross-functional teams on data contracts and access requirements
Requirements
• 6+ years of experience operating production data systems
• Strong expertise in Apache Kafka and Kafka Connect
• Production experience with Java and stateful stream processing; Apache Flink preferred
• Expert-level SQL and Python skills
• Experience with AWS data services and infrastructure as code
• AI-forward engineering mindset with experience using agentic development tools