Databricks Architect
Abhimanyu ChauhanUnited StatesSENIORPosted 1h ago
DatabricksSparkPySparkSQLDelta LakeAWSS3GlueIAMLambdaKinesisCI/CDGitDevOpsTerraform
About the Role
We are looking for a Databricks Architect with 12+ years of experience to join our team. This role focuses on designing and implementing scalable data solutions using Databricks and AWS.
Key Responsibilities
• Design and implement data architecture solutions using Databricks
• Lead technical discussions and guide engineering teams
• Develop and maintain architectural blueprints and documentation
• Implement and optimize data workflows and orchestration
• Ensure data quality and performance through Delta Lake features
Requirements
• 7+ years in data engineering or data architecture
• 3+ years hands-on experience with Databricks
• Strong expertise in Spark, PySpark, SQL, and distributed data systems
• Deep understanding of Delta Lake features (ACID, OPTIMIZE, ZORDER, Auto Loader)
• Experience with workflows/orchestration and Databricks REST APIs
• Hands-on expertise with AWS (S3, Glue, IAM, Lambda, Kinesis)
• Familiarity with CI/CD, Git, DevOps, and IaC (Terraform preferred)
• Strong analytical and problem-solving abilities
• Excellent communication and stakeholder management skills