Databricks Architect
K L Narasimha ReddyRemoteMIDPosted 2h ago
AWS DatabricksDelta Live TablesUnity CatalogSpark SQLETLDevOpsCI/CDPhoton enginejob clustersDBXSSISColdFusionTableauReactPEGA
About the Role
We are looking for a Databricks Architect to own the end-to-end target state architecture on AWS Databricks. This role involves technical runway across ETL, data products, and downstream integrations.
Key Responsibilities
• Define and enforce target Databricks architecture, Delta Live Tables (DLT) patterns, Unity Catalog governance, and security standards (including PHI/PII protection)
• Design migration blueprints and mapping logic for transpiling SSIS packages and ColdFusion scheduled tasks into Databricks notebooks and Spark SQL
• Architect the conformed data product layer for downstream analytics, Tableau reports, React apps, and PEGA workflow consumption
• Guide technical standards for DevOps, CI/CD automation, and performance optimization on Databricks clusters (Photon engine, job clusters)
• Fluent in DBX architecture, optimization techniques
• Healthcare experience (payer) is expected
Requirements
• Experience with AWS Databricks and Delta Live Tables
• Knowledge of Unity Catalog governance and security standards
• Experience with ETL processes and data products
• Familiarity with SSIS, ColdFusion, Tableau, React, and PEGA
• Healthcare experience in the payer domain