Jobs → Engineering → AI Engineer

AI Engineer

Marzia Rahman SumaitaUnited StatesMIDPosted 11h ago
LangGraphLLM EvalsPythonNode.jsJavaScriptTypeScriptAWS BedrockClaudeAWSLLM observabilityArizeOpenTelemetry
About the Role We are looking for an AI Engineer to build an internal AI developer platform where agents are treated like real software: stateful, tested and measured. Key Responsibilities • Build and debug LangGraph agent workflows (Python) with human-in-the-loop steps • Extend the eval harness and run A/B tests between agent and prompt variants • Improve prompts through measured, regression-tested changes • Extend the collaborative human-agent UI (Node.js) Requirements • Hands-on LangGraph: state graphs, checkpointing, interrupts, tool-calling agents • LLM evals: golden datasets, LLM-as-judge, A/B comparisons on quality, cost and latency • Strong prompt engineering, including structured outputs • Python; Claude on AWS Bedrock a plus Nice to have • JavaScript/TypeScript front end (Tiptap or Y.js a plus) • LLM observability (Arize, OpenTelemetry) • Node.js and AWS

Similar projects

Senior DevOps Engineer
Sadna singh · AWS, Kubernetes, Terraform
DevOps Engineer
Andrew Hunt · AWS, GCP, Private Cloud
Azure Cloud Engineer
Khalil Dhalait · Microsoft Azure, AHDS, APIM
Early · 0 applied1 of 6,184 projects

Apply with AI cover letter

AI writes a personalized application in 19 seconds. Just upload your resume.

No credit card · First application free
© 2026 Freelanly · Terms · Privacy