4 months ago
Milan, ItalyMid Level
Responsibilities
- Build and maintain API management software for AI and LLM applications and its underlying stack.
- Implement multi-LLM routing and balancing, semantic caching and routing, MCP, proxying, load balancing, and database support features.
- Troubleshoot bugs, tune performance, and perform low-level optimizations.
- Integrate Kong with third-party deployment platforms and tooling.
- Write product documentation and complete additional tasks assigned by the manager.
Requirements
- At least 3 years of programming experience in server-side applications and components.
- Hands-on experience with Go or Rust.
- Experience building and debugging highly scalable, distributed, reliable, and resilient applications.
- Strong hands-on expertise troubleshooting and profiling Linux systems.
- Experience with distributed systems, the Linux networking stack, and computer systems programming across L7 and L4 transports and protocols.
- Familiarity with AI and LLM concepts and application development.
- Strong ownership, verbal and written communication skills, and comfort working with a remotely distributed team.
- Bonus: hands-on experience with NGINX, OpenResty, Kong, LuaJIT, Envoy, or Istio.
About Kong
Kong builds an open-source and commercial platform for API and AI connectivity, including Kong Gateway, Kong Konnect, and service mesh tools (Kuma/Kong Mesh) to secure, manage, and observe APIs and LLM traffic across clouds. It sells subscriptions and cloud services for API lifecycle management, security, and traffic governance to enterprises and platform teams. Founded in 2017 and headquartered in San Francisco, Kong is privately held.