Data Engineer / ETL Developer
Praveen KumarUnited StatesMIDPosted 16m ago
Apache NiFiPySparkAWS GlueSQLMySQLPostgreSQLAWS DocumentDBApache KafkaETL development
About the Role
We are looking for a Data Engineer / ETL Developer with healthcare experience to join our team. This role involves working with various data technologies and platforms to develop and maintain ETL processes.
Key Responsibilities
• Design and develop ETL processes using Apache NiFi, PySpark, and AWS Glue
• Write complex SQL queries and perform performance tuning
• Work with MySQL, PostgreSQL, and AWS DocumentDB databases
• Implement and support streaming platforms like Apache Kafka
• Troubleshoot production issues, perform RCA, and implement fixes
• Support GBD/RX, regular projects, and Knox initiatives
• Coordinate and execute SIT, regression testing, and data validation
Requirements
• Strong hands-on experience with Apache NiFi, PySpark, and AWS Glue
• Expertise in complex SQL queries and performance tuning
• Experience with MySQL, PostgreSQL, and AWS DocumentDB
• Good knowledge of Apache Kafka or similar streaming platforms
• Experience in ETL development and production support
• Ability to troubleshoot production issues, perform RCA, and implement fixes
• Experience supporting GBD/RX, regular projects, and Knox initiatives
• Ability to coordinate and execute SIT, regression testing, and data validation