Azure Databricks Engineer
Chris KUnited StatesSENIORPosted 4d ago
DatabricksUnity CatalogDelta LakeSpark UIMLflowPythonPySparkSQLJavaETLELTMicrosoft AzureAzure DatabricksADLS Gen2Azure Data FactoryApache SparkDevOpsMLOpsGitCI/CDOpenShiftKubernetesTerraformIaCDatabricks securityAccess controlsSecrets managementIdentity integrationData governanceDatabricks workflowsJob orchestrationMonitoringApache AirflowAWSS3IAM
About the Role
We are looking for an Azure Databricks Engineer to join Brown Brothers Harriman. This role involves supporting the design, implementation, and ongoing development of BBH’s Databricks data platform. You will work across technology and data teams to build scalable data solutions on Databricks and Azure, with a strong focus on data engineering, integration, security, and automation in a large enterprise environment.
Key Responsibilities
• Support the design, implementation, and ongoing development of BBH’s Databricks data platform
• Work across technology and data teams to build scalable data solutions on Databricks and Azure
• Focus on data engineering, integration, security, and automation in a large enterprise environment
Requirements
• Hands-on experience with Databricks Workspace, Unity Catalog, Delta Lake, Spark UI, MLflow
• Strong Python, PySpark, SQL, and/or Java — ETL/ELT pipeline development and optimization
• Strong Microsoft Azure experience: Azure Databricks, ADLS Gen2, Azure Data Factory
• Apache Spark development, troubleshooting, and performance tuning
• DevOps/MLOps: Git, CI/CD, OpenShift, Kubernetes, Terraform/IaC
• Databricks security, access controls, secrets management, identity integration, data governance
• Databricks workflows, job orchestration, monitoring, and production support
• Knowledge of Apache Airflow
• Ability to collaborate across enterprise architecture, security, and governance teams
Nice-to-Have
• AWS experience (S3, IAM)
• Experience delivering production-grade Databricks solutions in large, security/governance-heavy enterprise environments