Databricks Architect
David (P Md Zubear)RemoteMIDPosted 2h ago
AWS DatabricksDelta Live TablesUnity CatalogPHI/PII protectionSSISColdFusionSpark SQLTableauReactPEGADevOpsCI/CDPhoton engineDBX
About the Role
We are looking for a Databricks Architect to own the end-to-end target state architecture on AWS Databricks and technical runway across ETL, data products, and downstream integrations.
Key Responsibilities
• Define and enforce target Databricks architecture, Delta Live Tables (DLT) patterns, Unity Catalog governance, and security standards (including PHI/PII protection).
• Design migration blueprints and mapping logic for transpiling SSIS packages and ColdFusion scheduled tasks into Databricks notebooks and Spark SQL.
• Architect the conformed data product layer for downstream analytics, Tableau reports, React apps, and PEGA workflow consumption.
• Guide technical standards for DevOps, CI/CD automation, and performance optimization on Databricks clusters (Photon engine, job clusters).
• Fluent in DBX architecture, optimization techniques.
Requirements
• Healthcare Payer experience is a must.
• Experience with AWS Databricks, Delta Live Tables, Unity Catalog, and security standards.
• Knowledge of SSIS, ColdFusion, Spark SQL, Tableau, React, PEGA, DevOps, CI/CD, and Photon engine.