Loading...
Mid LevelFull-timePythonJavaRustC#Node.jsAWSGCPAzureKubernetesGo
Salary Range
$102,000 - $138,000 /year
This salary is estimated based on similar roles. The actual salary may vary.
About the Role
DevRev is seeking experienced software engineers to join our team focused on AI performance and benchmarking. This role involves building and scaling applications, APIs, and cloud architectures, with a focus on AI systems in enterprise settings.
Key Responsibilities
- →Participate in a structured training track to develop expertise in AI benchmarking, profiling, and performance tuning.
- →Build and scale benchmarking infrastructure for evaluating AI systems in enterprise settings.
- →Design agent evaluation pipelines that measure reasoning, accuracy, alignment, and user outcomes.
- →Collaborate with AI and Infra teams to instrument model-serving systems.
- →Develop data and telemetry pipelines that capture model performance, latency, and quality
- →Contribute to DevRev’s open benchmarking frameworks.
- →Work with cross-functional teams to ensure benchmarks reflect real-world customer value and system impact.
Requirements
- ✓3–10+ years of experience as a Software Engineer in backend, systems, or infrastructure roles
- ✓Strong foundation in Python or similar backend languages
- ✓Hands-on experience in building APIs and cloud-native architectures
- ✓Understanding of metrics, profiling, or observability tools
- ✓Curiosity and commitment to learn AI benchmarking, LLM evaluation, and performance frameworks
- ✓Strong analytical and product intuition
- ✓Bonus: exposure to vector search, model tuning, or open-source contributions
Free to sign up. Takes 30 seconds.
