Azure Databricks Platform Engineer
Yerramsetty LolakshiBelgiumSENIORPosted 48m ago
AzureDatabricksTerraformAI/MLETLDatabasesAzure Data Lake Storage Gen2
About the Role
Join the Digital Solutions service of a Flemish government agency (policy area Environment) and design and roll out a secure, scalable and manageable Azure Databricks environment for data scientists to collaborate, develop models, and apply AI responsibly.
Key Responsibilities
• Design and set up a new Azure Databricks environment within a prepared Azure subscription
• Deploy the platform reproducibly with Terraform (Infrastructure as Code)
• Provision Databricks Workspaces, compute policies, repositories, jobs/workflows and access models
• Integrate with Azure Data Lake Storage Gen2 and other Azure resources
• Set up the basics for AI/ML workloads
• Implement logging, monitoring, auditability and cost control
• Deliver technical documentation, architecture description, runbook and knowledge transfer
Requirements
• Deep Azure knowledge
• Hands-on experience with Azure Databricks
• Strong Infrastructure as Code skills with Terraform
• Knowledge of AI/ML platform requirements
• Experience with ETL and Databases
• Experience with Azure Data Lake Storage Gen2
• Architectural maturity and strong documentation skills