Kong

Software Engineer 2, AI Gateway

Kong
Apply
1 day ago
Milan, ItalyMid Level

Responsibilities

  • Build and maintain API management software for AI and LLMs and its underlying stack.
  • Implement multi-LLM routing and balancing, semantic caching and routing, MCP, proxying, load balancing, and database-support features.
  • Troubleshoot bugs, tune performance, and perform low-level optimizations.
  • Integrate Kong with third-party deployment platforms and tooling.
  • Write product documentation and complete additional tasks assigned by the manager.

Requirements

  • At least 3 years of programming experience with server-side applications and components.
  • Hands-on experience with either Golang or Rust.
  • Experience building and debugging highly scalable, distributed, reliable, and resilient applications.
  • Hands-on low-level expertise in Linux systems troubleshooting and profiling.
  • Experience with distributed systems, the Linux networking stack, and computer systems programming, including L4 and L7 transports and protocols.
  • Familiarity with AI and LLM concepts and application development.
  • Strong ownership, communication, and documentation skills.

Tech Stack

AmbassadorGoIstioLinuxRust

Categories

Kong

About Kong

1,001-5,000 employees

Kong builds an open-source and commercial platform for API and AI connectivity, including Kong Gateway, Kong Konnect, and service mesh tools (Kuma/Kong Mesh) to secure, manage, and observe APIs and LLM traffic across clouds. It sells subscriptions and cloud services for API lifecycle management, security, and traffic governance to enterprises and platform teams. Founded in 2017 and headquartered in San Francisco, Kong is privately held.

Contact me