Gong.io

Software Architect, AI Applications

Gong.io
Apply
3 hours ago
Tel Aviv-Yafo, IsraelStaff+

Responsibilities

  • Define the reference architecture and cross-system contracts for the Revenue Harness agentic framework.
  • Design and build agent orchestration, planning and reasoning loops, multi-step execution, multi-agent coordination, tools, integrations, context, memory, and model routing.
  • Contribute directly to system design and code while embedding with teams across domains.
  • Establish evaluation methodology, regression gates, production monitoring, guardrails, permissions, and reliability standards for non-deterministic systems.
  • Design high-concurrency stateful and stateless agent runtimes with lifecycle management, isolated workers, task queues, distributed state persistence, and cloud-native deployment.
  • Mentor engineers, raise design and engineering standards, and lead through influence across multiple teams.
  • Drive adoption of coding agents, AI code review, and agentic development workflows.

Requirements

  • 10+ years of backend development experience with strong Java expertise and modern frameworks such as Spring Boot.
  • Proven Staff- or Principal-level impact across multiple teams and the ability to lead through influence rather than authority.
  • Hands-on experience shipping production LLM applications such as agents, tool calling, RAG, or structured generation, including understanding of their failure modes.
  • Deep expertise designing large-scale distributed systems, including asynchronous, event-driven, and streaming architectures.
  • Ability to work across unfamiliar codebases, switch context across teams, identify high-impact opportunities, and communicate complex ideas clearly.
  • Experience mentoring engineers and driving adoption of AI-assisted development.
  • Preferred experience with MCP, Spring AI, LangChain, LangGraph, or equivalent agent frameworks and protocols.
  • Preferred experience with LLM evaluation, observability, multi-provider routing, vector databases, Elasticsearch, OpenSearch, or knowledge graphs.
  • Familiarity with prompt injection, data leakage, agent permission models, and other AI security concerns.
  • Working knowledge of Python alongside a JVM stack and experience in B2B SaaS, CRM, or revenue technology are preferred.

Benefits

  • Flexible hybrid work model combining work from home, on the go, and in-office work.
  • Ownership, autonomy, mentorship, and opportunities to influence products and engineering standards.

Tech Stack

ElasticsearchJavaKubernetesPythonSpring Boot
Gong.io

About Gong.io

1,001-5,000 employees

Gong builds a revenue intelligence platform that captures and analyzes customer interactions (calls, emails, meetings) to deliver insights, coaching, and forecasting for sales and customer-success teams. It sells its software by subscription to businesses and integrates with common CRM and collaboration tools; more than 5,000 companies use it. Founded in 2015 and headquartered in San Francisco, Gong is a privately held company.

Contact me