Jobs → Engineering → AI Platform Engineer

AI Platform Engineer

Roopali CharakUnited StatesMIDPosted 1h ago
PythonLangGraphLangChainLlamaIndexCrewAIAutoGenGoogle ADKLiteLLMvLLMVertex AIRAGVector DatabasesEmbeddingsSemantic SearchMCPAI AgentsTool/Function CallingRAGASDeepEvalPromptfooAI SecurityGuardrailsPrompt Injection ProtectionKubernetesDockerTerraformCI/CDGCPGKECloud RunOpenTelemetry
About the Role We are looking for an experienced AI Platform Engineer to build and operate production-grade Agentic AI platforms. This role involves working with LLM orchestration, model gateways, RAG pipelines, agent infrastructure, evaluation, security, and observability. Key Responsibilities • Build and operate production-grade Agentic AI platforms • Implement LLM orchestration, model gateways, RAG pipelines, and agent infrastructure • Ensure evaluation, security, and observability of AI systems • Design and implement solutions using AI frameworks and technologies Requirements • 6+ years of software/platform engineering experience • Hands-on experience building and operating Agentic AI / LLM systems in production • Strong experience in AI/ML infrastructure and platform engineering • Proficiency in Python programming • Experience with Agentic AI frameworks: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or Google ADK • Knowledge of LLM deployment and model gateways: LiteLLM, vLLM, Vertex AI • Familiarity with RAG, Vector Databases, Embeddings, and Semantic Search • Understanding of MCP, AI Agents, and Tool/Function Calling • Experience with LLM Evaluation: RAGAS, DeepEval, Promptfoo • Knowledge of AI Security, Guardrails, and Prompt Injection Protection • Experience with Kubernetes, Docker, Terraform, and CI/CD • Familiarity with GCP (GKE, Vertex AI, Cloud Run) preferred • Understanding of OpenTelemetry and LLM Observability

Similar projects

ETL Informatica Developer with Qlik Replicate
Sundeep K · ETL, Informatica, Qlik Replicate
ETL Python Developer
Sowjanya K · Python, ETL, SQL
Senior Ab Initio Developer
Amitesh Pandey · Ab Initio, ETL, SAP HANA
Early · 0 applied1 of 6,103 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy