Healthcare Data Engineer
Sarath NannapaneniRemoteSENIORPosted 13d ago
PythonPySparkSQLData AnalyticsAWSS3RedshiftLambdaEMRGlueApache AirflowData LakehouseHDFSHiveBASHShell ScriptingHealthcare Insurance DomainBig Data ProcessingData Pipeline DevelopmentAgile MethodologyTechnical Leadership
About the Role
We are looking for a Healthcare Data Engineer to join our team at CoreTek Labs. This role focuses on developing and maintaining data pipelines and solutions in the healthcare domain.
Key Responsibilities
• Develop and maintain data pipelines using Python and PySpark
• Implement data solutions on AWS services including S3, Redshift, Lambda, EMR, and Glue
• Utilize Apache Airflow for workflow management
• Work with Data Lakehouse architecture and Hive
• Perform BASH/Shell scripting for automation
• Apply knowledge of healthcare insurance domain
• Process big data and develop data pipelines
• Follow Agile methodology and provide technical leadership
Requirements
• 10+ years of experience in data engineering
• Strong Python scripting and PySpark skills
• Expertise in SQL and data analytics
• Experience with AWS services (S3, Redshift, Lambda, EMR, Glue)
• Knowledge of Apache Airflow
• Understanding of Data Lakehouse, HDFS, and Hive
• Proficiency in BASH/Shell scripting
• Familiarity with healthcare insurance domain
• Experience in big data processing and data pipeline development
• Agile methodology experience
Benefits
• Competitive hourly rate on C2C basis