Databricks Architect
Shiv SharmaUnited StatesMIDPosted 13d ago
Databricks ArchitectureLakehouse DesignApache SparkPySparkSQLDelta LakeAzureAWSGCPKafkaPub/SubEvent HubsKinesisData GovernanceSecurityCI/CDBatch Data ProcessingReal-Time Data Processing
About the Role
We are looking for a Databricks Architect to join our team. This role focuses on designing and implementing data architecture solutions using Databricks and related technologies.
Key Responsibilities
• Design and implement Databricks architecture and Lakehouse solutions
• Work with Apache Spark, PySpark, SQL, and Delta Lake technologies
• Integrate with cloud platforms including Azure, AWS, and GCP Databricks
• Implement solutions using Kafka, Pub/Sub, Event Hubs, or Kinesis
• Ensure data governance, security, and CI/CD practices
• Handle both batch and real-time data processing requirements
Requirements
• 8+ years of data engineering experience
• 3+ years of experience in Databricks architecture
• Strong knowledge of Apache Spark, PySpark, SQL, and Delta Lake
• Experience with cloud platforms (Azure, AWS, GCP)
• Familiarity with Kafka, Pub/Sub, Event Hubs, or Kinesis
• Understanding of data governance, security, and CI/CD practices