Databricks Platform Engineer
Vivek UpadhyayUnited StatesSENIORPosted 2h ago
DatabricksAWSAzureGCPApache SparkPythonSQLKafkaAWS KinesisAzure Event HubsAzure DevOpsGitHub ActionsJenkinsTableauPower BILookerMLOps
About the Role
We are looking for an experienced Databricks Platform Engineer to lead the design, implementation, and optimization of scalable, enterprise-grade data platforms.
Key Responsibilities
• Lead the design, implementation, and optimization of scalable, enterprise-grade data platforms
• Bring strong hands-on Databricks expertise and cloud platform experience
• Drive platform architecture and collaborate with technical and business stakeholders
• Support enterprise Databricks environments, platform scalability, governance, and operational efficiency
Requirements
• 15+ years of experience with Databricks clusters, notebooks, Delta Lake, Unity Catalog, and MLflow
• Experience with at least one cloud provider — AWS, Azure, or GCP
• Strong expertise in Apache Spark, Python, SQL, and distributed data processing
• Experience designing scalable data ingestion, transformation, storage, and analytics solutions
• Experience with Structured Streaming, Kafka, AWS Kinesis, or Azure Event Hubs
• Experience implementing CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or similar tools
Preferred Qualifications
• Databricks Certified Data Engineer Professional or Databricks Architect certification
• AWS, Azure, or GCP cloud architecture certifications
• Experience with BI tools such as Tableau, Power BI, or Looker
• Knowledge of machine learning workflows and MLOps
• Experience with large-scale data modernization and cloud migration projects