Senior Data Engineer
KUPPILI BHAVANI SHANKARUnited StatesSENIORPosted 55m ago
DatabricksSnowflakeApache SparkPySparkSQLDelta LakeETLELTLakehouseMedallion ArchitectureHealthcare Clinical DataEHREMRHL7FHIRCCDICD-10CPTLOINCSNOMEDRxNormHIPAAPHIHealthcare Data SecurityAzureAWS
About the Role
We are looking for an experienced Senior Data Engineer with expertise in healthcare clinical data, Databricks, and Snowflake to join our team. This role focuses on building scalable data pipelines and transforming complex clinical data into analytics-ready solutions.
Key Responsibilities
• Design and implement scalable data pipelines using Databricks and Snowflake
• Work with healthcare clinical data, including patient encounters, diagnoses, procedures, lab results, and medications
• Develop ETL/ELT processes and implement Lakehouse/Medallion Architecture
• Ensure compliance with healthcare standards and data security protocols
• Collaborate with stakeholders on data governance and analytics requirements
Requirements
• 8+ years of experience in data engineering with healthcare clinical data
• Strong hands-on expertise in Databricks and Snowflake
• Proficiency in Apache Spark, PySpark, and advanced SQL
• Experience with Delta Lake, ETL/ELT pipeline development
• Knowledge of healthcare standards: HL7, FHIR, CCD, ICD-10, CPT, LOINC, SNOMED & RxNorm
• Understanding of HIPAA, PHI, and healthcare data security
• Experience with Azure or AWS cloud platforms
Benefits
• Potential for contract extension beyond initial 3+ months