Senior Backend Engineer - AI Framework at Gongio

Gongio

Tel Aviv·8h ago

SeniorFull-timePythonJavaRustRailsMicroservicesGoAI

Salary Range

$132,600 - $179,400 /year

Estimated

This salary is estimated based on similar roles. The actual salary may vary.

About the Role

We are looking for a Senior Backend Engineer to join Gong’s AI Framework team. You will build the foundational platform that enables the entire organization to design, evaluate, deploy, and operate AI agents at scale. This is a new, high-impact team responsible for creating the frameworks, tools, and guardrails that power Gong’s agentic ecosystem.

Key Responsibilities

→Design and build Gong’s internal agentic framework, leveraging industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
→Build evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
→Provide robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails.
→Create APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
→Design integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem.

Requirements

✓7+ years of backend engineering experience, with strong system design and platform-building expertise.
✓Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently.
✓Hands-on experience with agentic systems and frameworks such as LangChain, LangSmith, ADK, or equivalent agent orchestration platforms.
✓Strong understanding of AI evaluation methodologies, including agent evaluations, prompt evaluation, regression testing, and quality monitoring.
✓High proficiency in Python for building production-grade AI frameworks and services.
✓Familiarity with Java and experience integrating backend platforms or tooling into Java-based systems.
✓Experience building observability, monitoring, or platform tooling for distributed systems.
✓Strong analytical skills and the ability to reason about complex, evolving AI-driven systems.
✓Experience with cloud platforms and scalable microservices architectures.
✓Excellent communication skills and a strong platform mindset, with experience enabling multiple teams.