Data Engineer / ETL Developer
Ravi kumarUnited StatesMIDPosted 16m ago
Apache NiFiPySparkAWS GlueSQLMySQLPostgreSQLAWS DocumentDBApache Kafka
About the Role
We are seeking an experienced Data Engineer / ETL Developer to join our team. This role involves developing and maintaining robust ETL pipelines and optimizing database performance.
Key Responsibilities
• Design, develop, maintain, and optimize ETL workflows using Apache NiFi, PySpark, and AWS Glue
• Write, analyze, and optimize complex SQL queries to support data processing and integration requirements
• Perform database development and performance tuning across MySQL, PostgreSQL, and AWS DocumentDB
• Develop and support data streaming solutions using Apache Kafka or similar streaming technologies
• Provide development and production support for GBD/RX, regular project activities, and Knox initiatives
• Troubleshoot production incidents, conduct root cause analysis (RCA), and implement permanent corrective actions
• Coordinate and execute System Integration Testing (SIT), regression testing, and data validation activities
• Collaborate with cross-functional teams to ensure data quality, reliability, and timely delivery of project requirements
• Monitor ETL processes, resolve data pipeline failures, and ensure smooth production operations
Requirements
• 6+ years of experience in ETL development with Apache NiFi, PySpark, and AWS Glue
• 6+ years of experience with complex SQL queries, performance tuning, MySQL, PostgreSQL, and AWS DocumentDB
• 3+ years of experience with Apache Kafka or similar streaming platforms
• Strong troubleshooting, analytical, and problem-solving skills
• Experience supporting production data pipelines and resolving critical data issues
• Hands-on experience with SIT, regression testing, and data validation
• Strong communication and collaboration skills
• Willingness and ability to work onsite in Mason, OH, five days per week