Jobs → Data & Analytics → GCP Databricks Architect / Data Engineer

About the Role We are looking for a highly skilled GCP Databricks Architect-level Data Engineer with strong hands-on experience in building, securing, and scaling enterprise data pipelines within a HIPAA-compliant healthcare environment. Key Responsibilities • Design and develop batch and streaming data pipelines using Databricks on GCP • Build PySpark, Spark SQL, and Delta Lake transformations • Develop and manage production workflows using Google Cloud Composer (Airflow) • Implement Medallion Lakehouse architecture (Bronze, Silver, Gold) • Optimize Delta Lake using partitioning, Z-Ordering, OPTIMIZE, and VACUUM • Ensure HIPAA compliance and secure PHI/PII data handling • Integrate GCS, Cloud SQL/PostgreSQL, and Apigee APIs • Configure Unity Catalog and implement data governance • Manage CI/CD deployments using GitHub Actions, Terraform, and Databricks Asset Bundles Requirements • 8+ years of hands-on Data Engineering experience • Strong production pipeline implementation experience • Healthcare data security and compliance knowledge • Ability to design and operationalize scalable Lakehouse architectures