Azure Databricks Engineer
Vamsi K.United StatesSENIORPosted 4d ago
DatabricksUnity CatalogDelta LakeSpark UIMLflowPythonPySparkSQLJavaETLELTMicrosoft AzureAzure DatabricksADLS Gen2Azure Data FactoryApache SparkDevOpsMLOpsGitCI/CDOpenShiftKubernetesTerraformIaCDatabricks securityAccess controlsSecrets managementIdentity integrationData governanceDatabricks workflowsJob orchestrationMonitoringApache AirflowAWSS3IAM
About the Role
We are looking for an Azure Databricks Engineer to support the design, implementation, and ongoing development of BBH’s Databricks data platform. This role involves working across technology and data teams to build scalable data solutions on Databricks and Azure, with a focus on data engineering, integration, security, and automation in a large enterprise environment.
Key Responsibilities
• Support the design, implementation, and ongoing development of BBH’s Databricks data platform
• Work across technology and data teams to build scalable data solutions on Databricks and Azure
• Focus on data engineering, integration, security, and automation in a large enterprise environment
Requirements
• Hands-on experience with Databricks Workspace, Unity Catalog, Delta Lake, Spark UI, MLflow
• Strong Python, PySpark, SQL, and/or Java for ETL/ELT pipeline development and optimization
• Strong Microsoft Azure experience: Azure Databricks, ADLS Gen2, Azure Data Factory
• Apache Spark development, troubleshooting, and performance tuning
• DevOps/MLOps: Git, CI/CD, OpenShift, Kubernetes, Terraform/IaC
• Databricks security, access controls, secrets management, identity integration, data governance
• Databricks workflows, job orchestration, monitoring, and production support
• Knowledge of Apache Airflow
• Ability to collaborate across enterprise architecture, security, and governance teams
Nice-to-Have
• AWS experience (S3, IAM)
• Experience delivering production-grade Databricks solutions in large, security/governance-heavy enterprise environments