Databricks Developer
Abhishek DevdharUnited StatesSENIORPosted 6d ago
PySparkSQLDelta LakeETLAzureAWSGCPGitCI/CD
About the Role
We are looking for an experienced Databricks Developer with strong hands-on expertise in PySpark, SQL, and Delta Lake to join our team.
Key Responsibilities
• Develop and maintain scalable ETL/ELT data pipelines using PySpark and SQL
• Design, create, and optimize Delta Lake tables for high-performance data processing
• Build and manage Databricks Workflows for pipeline orchestration and automation
• Write and execute unit tests to ensure code quality, reliability, and maintainability
• Troubleshoot data quality issues and ensure data accuracy and integrity
• Prepare clear technical documentation for solutions and pipeline configurations
• Participate in peer code reviews and follow engineering best practices
Requirements
• 8+ years of experience in Data Engineering, including 3+ years of hands-on Databricks experience
• Strong proficiency in PySpark and SQL
• Working knowledge of Delta Lake and at least one major cloud platform (Azure, AWS, or GCP)
• Familiarity with Git-based source control and CI/CD practices
• Ability to independently deliver technical solutions from development through deployment
Preferred Qualifications
• Databricks Certified Data Engineer Associate certification
• Experience with established data platform frameworks and engineering best practices
• Strong troubleshooting and problem-solving skills