Jobs → Engineering → AI Platform Engineer

AI Platform Engineer

Ajay KumarRemoteSENIORPosted 1h ago
PythonLangGraphLangChainLlamaIndexCrewAIAutoGenGoogle ADKLiteLLMPortkeyKong AI GatewayTrueFoundryvLLMTGIOllamaVertex AIRAGVector databasesEmbeddingsHybrid searchSemantic searchRerankingMCPTool callingAgent registriesLLMOpsRAGASDeepEvalPromptfooLangSmithLangfuseMLflowAI securityGuardrailsPrompt-injection protectionPII detectionData-leakage preventionKubernetesDockerGCPGKEVertex AICloud RunTerraformCI/CDOpenTelemetryDistributed tracingPerformance monitoringCost optimization
About the Role We are looking for an experienced AI Platform Engineer to build and operate a production-grade Agentic AI platform. This role requires strong hands-on experience in building scalable AI infrastructure and multi-agent orchestration systems. Key Responsibilities • Build and operate a production-grade Agentic AI platform • Design and implement scalable AI infrastructure • Develop multi-agent orchestration systems • Implement LLM gateways and RAG pipelines • Ensure reliability, scalability, security, and cost optimization of the AI platform Requirements • 10+ years of experience in software/platform engineering • Strong Python development skills • Hands-on experience with Agentic AI frameworks such as LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or Google ADK • Experience building production-grade multi-agent orchestration systems • Expertise in LLM gateways such as LiteLLM, Portkey, Kong AI Gateway, or TrueFoundry • Experience with LLM serving using vLLM, TGI, Ollama, or Vertex AI • Strong knowledge of RAG, vector databases, embeddings, hybrid search, semantic search, and reranking • Experience with MCP (Model Context Protocol), tool calling, and agent registries • Hands-on experience with LLMOps, evaluation frameworks, and observability tools • Knowledge of AI security, guardrails, prompt-injection protection, PII detection, and data-leakage prevention • Experience with Kubernetes, Docker, GCP (GKE, Vertex AI, Cloud Run), Terraform, and CI/CD • Understanding of OpenTelemetry, distributed tracing, performance monitoring, and cost optimization

Similar projects

ETL Informatica Developer with Qlik Replicate
Sundeep K · ETL, Informatica, Qlik Replicate
ETL Python Developer
Sowjanya K · Python, ETL, SQL
Senior Ab Initio Developer
Amitesh Pandey · Ab Initio, ETL, SAP HANA
Early · 0 applied1 of 6,103 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy