Databricks Engineer
Sateesh BesthaRemoteSENIORPosted 7h ago
DatabricksApache SparkPySparkPythonCloud technologiesETL/ELTDelta LakeDelta Live TablesUnity CatalogAWSAzureGCPCI/CDGitDevOpsData LakeLakehouse architecture
About the Role
We are looking for an experienced Senior Databricks Engineer to join our team. This role focuses on designing and implementing scalable enterprise-level data engineering solutions using Databricks and related technologies.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark
• Build and optimize ETL/ELT workflows using PySpark and Python
• Develop solutions using Databricks Lakehouse architecture
• Work with Delta Lake, Delta Live Tables (DLT), and Unity Catalog
• Implement data ingestion, transformation, and integration processes
• Optimize Spark jobs for performance and cost efficiency
• Work with AWS, Azure, or GCP cloud platforms
• Implement data quality, governance, security, and monitoring
• Troubleshoot complex data engineering and production issues
Requirements
• 8–10+ years of Data Engineering experience
• Strong hands-on experience with Databricks
• Expertise in Apache Spark, PySpark, and Python
• Strong SQL and data modeling skills
• Hands-on experience with Delta Lake and Delta Tables
• ETL/ELT pipeline development
• Databricks Workflows and Delta Live Tables (DLT)
• AWS / Azure / GCP
• CI/CD, Git, and DevOps practices
• Data Lake and Lakehouse architecture