Principal Databricks Engineer
Vidyasree BatchuRemoteSENIORPosted 4h ago
DatabricksMicrosoft AzurePythonPySparkKimball Dimensional ModelingData EngineeringData ArchitectureAzure Synapse AnalyticsData Pipeline DevelopmentNoSQLNormalized Data ModelsData Warehouse ModernizationData Science IntegrationComputer VisionAgentic AI Workflows
About the Role
We are looking for an experienced Principal Databricks Engineer to provide hands-on technical leadership and drive modern data engineering initiatives on Microsoft Azure Databricks.
Key Responsibilities
• Design, develop, and productionize data pipelines using Databricks on Azure
• Lead data modeling initiatives using Kimball dimensional modeling principles
• Drive migration from Azure Synapse Analytics to Databricks
• Establish data engineering standards, architecture, and best practices
• Collaborate with data engineering and data science teams
• Support AI capabilities, computer vision, and agentic engineering initiatives
• Develop and optimize approximately 80 petroleum data tables for production
Requirements
• Strong expertise in building scalable data pipelines and data architecture
• Proficiency in Python, PySpark, and Kimball dimensional modeling
• Experience with Databricks, Microsoft Azure, and Azure Synapse Analytics
• Knowledge of data pipeline development and data modeling
Good to Have
• Experience with NoSQL and Normalized Data Models
• Data Warehouse Modernization
• Data Science Integration
• Databricks AI Capabilities
• Computer Vision
• Agentic AI Workflows