Loading...
Mid LevelFull-timePythonRailsAWSGCPAzureKubernetesDockerMicroservicesCI/CDAI
Salary Range
$20,400 - $27,600 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
We are seeking an experienced ML Backend Engineer to join our team. This role involves designing and building core backend services that power AI/ML runtime systems.
Key Responsibilities
- →Design and build core backend services powering AI/ML runtime including orchestration, session/state management, and tools/services integration
- →Implement end-to-end retrieval and memory systems covering ingestion, embeddings, indexing, vector search, ranking, caching, and lifecycle management
- →Productionize ML workflows with feature/metadata services, model integration contracts, and evaluation hooks
- →Drive performance, reliability, and cost optimization with strong SLO ownership and observability practices
- →Collaborate with applied ML teams on model routing, prompts/tools, evaluation datasets, and safe releases
- →Translate business requirements into scalable technical designs, define NFR benchmarks, and review architecture for extensibility and best practices
- →Lead troubleshooting, root-cause analysis, and POCs to validate technology and design decisions
Requirements
- ✓Total experience of 5.5 years+
- ✓Strong expertise in Python and backend engineering with experience building scalable, distributed microservices
- ✓Hands-on experience designing and delivering end-to-end RAG workflows in production systems
- ✓Solid understanding of ML solution design, including embeddings, retrieval, ranking, feature engineering, and evaluation strategies
- ✓Experience with vector databases and implementing chunking, indexing, vector search, re-ranking, caching, and memory patterns
- ✓Knowledge of LLM/NLP engineering, including prompt engineering, model integration, orchestration tools, and evaluation instrumentation
- ✓Experience productionizing ML systems with observability, online/offline parity, and performance optimization
- ✓Strong backend integration skills using REST/gRPC APIs, Docker, Kubernetes, CI/CD, and cloud platforms
- ✓Ability to independently design, ship, and operate reliable, scalable, and cost-efficient ML-backed backend systems
