Data Integration Engineer
Bhupender singhUnited StatesMIDPosted 4d ago
C#JavaApache KafkaAWSPostgreSQLAI coding agentsTerraform
About the Role
We are seeking an experienced Data Integration Engineer to build and support scalable, event-driven integrations across enterprise applications, databases, and cloud platforms.
Key Responsibilities
• Design and develop real-time and batch data integration pipelines
• Build event-driven solutions using Apache Kafka, AWS EventBridge, Amazon SQS, AWS Lambda, and Amazon ECS
• Develop backend services, REST APIs, and message consumers using .NET (C#) or Java
• Design data models, optimize SQL queries, and manage PostgreSQL database operations
• Implement reliable messaging patterns, including retries, idempotency, duplicate handling, message ordering, and dead-letter queues
• Perform integration testing, payload validation, record-count reconciliation, and production troubleshooting
• Manage infrastructure using Terraform and support CI/CD automation
• Use AI coding agents for code generation, debugging, automated testing, and code reviews
• Monitor distributed systems, resolve integration issues, and maintain technical documentation
• Collaborate with architects, application teams, and business stakeholders to deliver reliable integration solutions
Requirements
• 5+ years of experience in backend development, data integration, or enterprise systems
• Strong hands-on experience with .NET (C#) or Java
• Practical experience with Apache Kafka, including topics, partitions, consumer groups, offsets, and failure handling
• Experience with AWS EventBridge, SQS, Lambda, ECS, and IAM
• Strong SQL skills and experience with Amazon Aurora PostgreSQL or PostgreSQL
• Understanding of event-driven architecture, distributed systems, and enterprise integration patterns
• Hands-on experience using AI coding agents, with the ability to validate generated code
• Experience developing automated tests and troubleshooting production integrations
Preferred Qualifications
• Snowflake and downstream data integration
• Terraform and Infrastructure as Code (IaC)
• Kubernetes or Amazon EKS
• AWS CloudWatch monitoring and logging
• Avro, Schema Registry, or Debezium/CDC
• CI/CD pipelines and automated integration testing
• Working knowledge of both .NET (C#) and Java