Databricks Architect
SAI VIVEK GUDUPURemoteMIDPosted 12d ago
Data EngineeringDatabricks ArchitectureApache SparkPySparkSQLDelta LakeAzureAWSGCPApache KafkaGCP Pub/SubAzure Event HubsAWS KinesisLakehouse ArchitectureData GovernanceData SecurityETL migrationCI/CDdata pipeline optimizationUnity CatalogDelta Live TablesDatabricks WorkflowsPower BITableauDataOpsDevOpsMLOps
About the Role
We are looking for a Databricks Architect to join our team. This role requires extensive experience in data engineering and hands-on Databricks architecture.
Key Responsibilities
• Design and implement Databricks architecture solutions
• Manage data platforms and ensure data governance and security
• Optimize data pipelines and ETL migrations
• Work with cloud platforms like Azure, AWS, and GCP
Requirements
• 8+ years of experience in Data Engineering and Data Platforms
• 3+ years of hands-on Databricks Architecture experience
• Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake
• Experience with Azure, AWS, or GCP Databricks
• Knowledge of Lakehouse Architecture, Data Governance, and Data Security
• Experience with ETL migration, CI/CD, and data pipeline optimization