3 months ago
Milan, ItalyMid Level
Responsibilities
- Build and maintain API management software for AI and LLM applications and its underlying stack.
- Implement multi-LLM routing and balancing, semantic caching and routing, MCP, proxying, load balancing, and database support features.
- Troubleshoot bugs, tune performance, and perform low-level optimizations.
- Integrate Kong with third-party deployment platforms and tooling.
- Write product documentation and complete additional tasks assigned by the manager.
Requirements
- At least 3 years of programming experience in server-side applications and components.
- Hands-on experience with Go or Rust.
- Experience building and debugging highly scalable, distributed, reliable, and resilient applications.
- Strong hands-on expertise troubleshooting and profiling Linux systems.
- Experience with distributed systems, the Linux networking stack, and computer systems programming across L7 and L4 transports and protocols.
- Familiarity with AI and LLM concepts and application development.
- Strong ownership, verbal and written communication skills, and comfort working with a remotely distributed team.
- Bonus: hands-on experience with NGINX, OpenResty, Kong, LuaJIT, Envoy, or Istio.
