Jobs → Data & Analytics → Databricks Architect

About the Role We are seeking a Databricks Architect or Engineer for a 6+ month Contract to Hire position. The role requires expertise in Databricks data engineering and a preference for local presence in Atlanta, GA or Birmingham, AL. Key Responsibilities • Design medallion architecture (Bronze/Silver/Gold) using Delta Lake and Unity Catalog • Define data quality frameworks using Lakeflow Declarative Pipelines • Develop reusable ingestion and data validation patterns using PySpark, Auto Loader, notebooks, and shared libraries • Establish CI/CD processes using Databricks Asset Bundles and Git • Build and optimize Delta Lake pipelines using PySpark and SQL • Implement data quality expectations, monitoring, and reporting • Develop Databricks SQL and AI/BI dashboards to track data quality and remediation • Migrate Alteryx workflows to Databricks using PySpark/SQL and Lakeflow Jobs • Collaborate with client developers and provide hands-on Databricks knowledge transfer Requirements • Expertise in Databricks data engineering • Experience with Delta Lake, Unity Catalog, and Lakeflow Declarative Pipelines • Proficiency in PySpark, SQL, and related technologies • Ability to design and implement data quality frameworks • Experience with CI/CD processes and Databricks Asset Bundles • Strong problem-solving and analytical skills • Excellent communication and collaboration abilities