AI Platform Engineer
Ajay KumarRemoteSENIORPosted 1h ago
PythonLangGraphLangChainLlamaIndexCrewAIAutoGenGoogle ADKLiteLLMPortkeyKong AI GatewayTrueFoundryvLLMTGIOllamaVertex AIRAGVector databasesEmbeddingsHybrid searchSemantic searchRerankingMCPTool callingAgent registriesLLMOpsRAGASDeepEvalPromptfooLangSmithLangfuseMLflowAI securityGuardrailsPrompt-injection protectionPII detectionData-leakage preventionKubernetesDockerGCPGKEVertex AICloud RunTerraformCI/CDOpenTelemetryDistributed tracingPerformance monitoringCost optimization
About the Role
We are looking for an experienced AI Platform Engineer to build and operate a production-grade Agentic AI platform. This role requires strong hands-on experience in building scalable AI infrastructure and multi-agent orchestration systems.
Key Responsibilities
• Build and operate a production-grade Agentic AI platform
• Design and implement scalable AI infrastructure
• Develop multi-agent orchestration systems
• Implement LLM gateways and RAG pipelines
• Ensure reliability, scalability, security, and cost optimization of the AI platform
Requirements
• 10+ years of experience in software/platform engineering
• Strong Python development skills
• Hands-on experience with Agentic AI frameworks such as LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or Google ADK
• Experience building production-grade multi-agent orchestration systems
• Expertise in LLM gateways such as LiteLLM, Portkey, Kong AI Gateway, or TrueFoundry
• Experience with LLM serving using vLLM, TGI, Ollama, or Vertex AI
• Strong knowledge of RAG, vector databases, embeddings, hybrid search, semantic search, and reranking
• Experience with MCP (Model Context Protocol), tool calling, and agent registries
• Hands-on experience with LLMOps, evaluation frameworks, and observability tools
• Knowledge of AI security, guardrails, prompt-injection protection, PII detection, and data-leakage prevention
• Experience with Kubernetes, Docker, GCP (GKE, Vertex AI, Cloud Run), Terraform, and CI/CD
• Understanding of OpenTelemetry, distributed tracing, performance monitoring, and cost optimization