Data Architect
Vennela krishnaUnited StatesMIDPosted 14d ago
DatabricksLakeflowDelta LakeUnity CatalogPySparkPythonSQLETLLakehouseMedallion architectureAlteryx
About the Role
We are looking for an experienced Data Architect to join our team on a long-term engagement. This role focuses on designing and implementing scalable Lakehouse architectures using the Databricks ecosystem.
Key Responsibilities
• Design and implement end-to-end data architecture and engineering solutions using Databricks.
• Develop scalable data ingestion and transformation pipelines using PySpark, Python, and SQL.
• Build and optimize Lakehouse and Medallion architectures using Delta Lake.
• Leverage Lakeflow and Unity Catalog for pipeline orchestration, governance, and data management.
• Architect and execute ETL and data migrations from legacy platforms to Databricks.
• Build reusable, metadata-driven and configuration-driven migration frameworks.
• Implement data quality checks, validation, reconciliation, and performance optimization.
• Establish CI/CD pipelines and automation practices for data engineering solutions.
• Assess existing ETL workloads and define migration strategies, design patterns, and implementation roadmaps.
• Provide technical leadership and collaborate with onshore/offshore engineering teams and client stakeholders.
Requirements
• Strong hands-on experience with Databricks, Lakeflow, Delta Lake, and Unity Catalog.
• Proficiency in PySpark, Python, and SQL.
• Proven experience in ETL modernization and migration to Databricks.
• Strong understanding of Lakehouse and Medallion architecture.
• Experience with data pipeline orchestration, CI/CD, data quality, and performance tuning.
• Experience building scalable, reusable data engineering frameworks.
• Excellent communication, client-facing, and technical leadership skills.
Preferred Qualifications
• Experience with Alteryx-to-Databricks migration.
• Familiarity with ETL modernization and migration tools.
• Experience with AI-assisted migration and automation approaches.