Azure Databricks Architect
Prarthna C.United StatesSENIORPosted 1h ago
Azure DatabricksPySparkApache SparkSQLAzure Data FactorydbtApache IcebergETLELTCI/CDData GovernanceData QualityDatabricks GenieAgentic IDEsAI-Assisted Development
About the Role
We are looking for an experienced Azure Databricks Architect who can combine enterprise-level architecture with strong hands-on engineering expertise. This role involves designing and delivering scalable Lakehouse architectures while leading engineering teams and remaining hands-on with development.
Key Responsibilities
• Design and deliver scalable Lakehouse architectures
• Lead engineering teams while maintaining hands-on development involvement
• Optimize and troubleshoot enterprise-scale data engineering solutions
• Implement ETL/ELT pipeline development and optimization
• Ensure data governance and quality standards
Requirements
• 10+ years of experience in data engineering
• Strong hands-on experience with Azure Databricks and Lakehouse Design
• Proficiency in PySpark, Apache Spark, and Advanced SQL
• Experience with Azure Data Factory, dbt, and Apache Iceberg
• Knowledge of CI/CD, Data Governance, and Data Quality
• Familiarity with Databricks Genie and Agentic IDEs
This is a hands-on architecture role, not a purely theoretical or documentation-focused position.