Jobs → Engineering → AI Platform Engineer

AI Platform Engineer

Shriyansh SachanUnited StatesSENIORPosted 11d ago
PythonGenerative AILLMsAgentic AIRAGmulti-agent orchestrationLangGraphLangChainSemantic KernelMicrosoft AzureAzure OpenAIFastAPIREST APIsmodel integrationsenterprise application architectureAI evaluationAI observabilityAI securityAI governanceproduction deploymentLLM gatewaysmodel routingrate limitingprovider fallbackAgent harness engineeringautomated evaluationshuman-in-the-loop workflowsAzure MonitorApplication InsightsOpenTelemetryLangfuseLangSmithDockerKubernetesCI/CDinfrastructure automation
About the Role We are looking for a Senior AI Platform Engineer with strong experience in Generative AI, Agentic AI, LLM platforms, and enterprise AI engineering to build scalable, secure, and observable AI platform capabilities. Key Responsibilities • Design and develop enterprise AI platforms supporting Agentic AI and multi-agent orchestration • Build AI workflows integrating LLMs, agents, APIs, tools, and enterprise data sources • Implement centralized LLM/AI gateways with authentication, authorization, rate limiting, routing, and policy enforcement • Develop RAG pipelines and reusable Python-based AI services • Implement AI observability, tracing, performance monitoring, and error tracking • Build automated evaluation frameworks, feedback loops, guardrails, and agent reliability controls • Support secure, scalable production deployments and continuous improvement of AI applications Requirements • Strong experience with Python, Generative AI, LLMs, and Agentic AI • Hands-on experience with RAG and multi-agent orchestration • Experience with frameworks such as LangGraph, LangChain, or Semantic Kernel • Cloud AI experience, preferably Microsoft Azure / Azure OpenAI • Knowledge of FastAPI, REST APIs, model integrations, and enterprise application architecture • Experience with AI evaluation, observability, security, governance, and production deployment Preferred Skills • LLM gateways, model routing, rate limiting, and provider fallback • Agent harness engineering, automated evaluations, and human-in-the-loop workflows • Azure Monitor, Application Insights, OpenTelemetry, Langfuse, or LangSmith • Docker, Kubernetes, CI/CD, and infrastructure automation

Similar projects

Java Full Stack Developer
Jyothi More · Java, Python, microservices
Full Stack Web Developer
Abhishek Sharma · Kiro, React, Angular
Full Stack Development Manager
Anand Budiga · .NET/C#, React, Angular
Early · 0 applied1 of 7,999 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy