Databricks Developer
Akashdeep RajputUnited StatesMIDPosted 6h ago
Databricks Lakehouse PlatformPySparkSpark SQLApache SparkDelta LakeData pipelinesDelta TablesSpark performance tuningData governanceAgile development
About the Role
We are looking for a Databricks Developer to join our team. This role focuses on designing and developing scalable data pipelines using the Databricks Lakehouse Platform.
Key Responsibilities
• Design and develop scalable data pipelines using Databricks
• Build and optimize data processing solutions using PySpark and Spark SQL
• Implement data validation and quality checks
• Optimize Spark jobs for performance and cost efficiency
• Support enterprise data modernization and Lakehouse initiatives
Requirements
• Strong hands-on experience with Databricks Lakehouse Platform
• Expertise in PySpark and Spark SQL
• Strong knowledge of Apache Spark and Delta Lake
• Experience building scalable batch and real-time data pipelines
• Hands-on experience with Delta Tables, partitioning, and schema evolution
• Expertise in Spark performance tuning and optimization
• Knowledge of data governance, security, and data quality
• Experience with Agile development methodologies