Senior Data Engineer
Tanuja R.United StatesSENIORPosted 6d ago
DatabricksPySparkPythonSQLLakehouse ArchitectureDelta LakedbtUnity CatalogLakeflow
About the Role
We are looking for experienced Senior Data Engineers with expertise in Databricks and modern data engineering. This role involves designing, developing, and optimizing scalable data pipelines in production environments.
Key Responsibilities
• Design and develop scalable data pipelines
• Optimize and support data solutions in production
• Implement Lakehouse architecture and Delta Lake
• Utilize dbt for data transformation and modeling
• Manage Unity Catalog and data governance
• Develop modern Databricks pipelines using Lakeflow
• Support on-premises to cloud/Databricks migration
• Troubleshoot and optimize production performance
Requirements
• 9+ years of Data Engineering experience
• 5+ years of hands-on Databricks experience
• Strong expertise in PySpark, Python, and SQL
• Experience with Lakehouse Architecture and Delta Lake
• Proficiency in dbt for data transformation
• Knowledge of Unity Catalog and data governance
• Experience with Lakeflow and Databricks pipeline development
• Background in on-premises to cloud/Databricks migration
• Production troubleshooting, debugging, and performance optimization skills