AI Platform Engineer
Roopali CharakUnited StatesMIDPosted 1h ago
PythonLangGraphLangChainLlamaIndexCrewAIAutoGenGoogle ADKLiteLLMvLLMVertex AIRAGVector DatabasesEmbeddingsSemantic SearchMCPAI AgentsTool/Function CallingRAGASDeepEvalPromptfooAI SecurityGuardrailsPrompt Injection ProtectionKubernetesDockerTerraformCI/CDGCPGKECloud RunOpenTelemetry
About the Role
We are looking for an experienced AI Platform Engineer to build and operate production-grade Agentic AI platforms. This role involves working with LLM orchestration, model gateways, RAG pipelines, agent infrastructure, evaluation, security, and observability.
Key Responsibilities
• Build and operate production-grade Agentic AI platforms
• Implement LLM orchestration, model gateways, RAG pipelines, and agent infrastructure
• Ensure evaluation, security, and observability of AI systems
• Design and implement solutions using AI frameworks and technologies
Requirements
• 6+ years of software/platform engineering experience
• Hands-on experience building and operating Agentic AI / LLM systems in production
• Strong experience in AI/ML infrastructure and platform engineering
• Proficiency in Python programming
• Experience with Agentic AI frameworks: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or Google ADK
• Knowledge of LLM deployment and model gateways: LiteLLM, vLLM, Vertex AI
• Familiarity with RAG, Vector Databases, Embeddings, and Semantic Search
• Understanding of MCP, AI Agents, and Tool/Function Calling
• Experience with LLM Evaluation: RAGAS, DeepEval, Promptfoo
• Knowledge of AI Security, Guardrails, and Prompt Injection Protection
• Experience with Kubernetes, Docker, Terraform, and CI/CD
• Familiarity with GCP (GKE, Vertex AI, Cloud Run) preferred
• Understanding of OpenTelemetry and LLM Observability