Jobs → Engineering → MLOps / LLMOps Engineer

About the Role We are looking for an MLOps / LLMOps Engineer to join our team. This role focuses on deploying and managing machine learning systems on Azure. Key Responsibilities • Deploy and run containerized FastAPI inference and agent services on Azure • Build and schedule data, embedding and re-indexing pipelines with Prefect • Set up LLM observability and evaluation with Langfuse, and gate releases on evaluation results • Manage Azure OpenAI capacity: rate limits, token budgets, cost and fallbacks • Operate the data layer: vector databases (Qdrant / Milvus), PostgreSQL, Snowflake, Redis • Own CI/CD, infrastructure as code, secrets and security for the platform Requirements • 5–8 years total experience • 3+ years of MLOps / DevOps for ML • Strong experience with Microsoft Azure • Core language: Python 3.11+ • Pipeline orchestration with Prefect 2.x/3.x • Containers & CI/CD with Docker, AKS or Azure Container Apps • Model & LLM serving with FastAPI services • LLMOps & observability with Langfuse • Azure security knowledge • Data & vector stores operations