Full-stack Software Engineer III/Senior, AI Gateway
ngrok Inc.18 hours ago
Base Salary
$166k - $248k/yr
Responsibilities
- Build and evolve AI-aware gateway components that classify and handle AI traffic in real time.
- Design and implement AI Gateway Traffic Policy Objects for rate limits, usage caps, and access rules.
- Build systems to measure AI requests, tokens, and related metadata accurately.
- Expose observable and explainable signals showing allowed or blocked traffic, applied policies, and accumulated usage.
- Develop AI-specific gateway abstractions that hide provider and infrastructure complexity from customers.
- Collaborate with Gateway, Customer Data, Platform, product, and design teams to align usage data, policy enforcement, and billing signals.
- Ship reliable production systems that handle traffic spikes, unexpected model behavior, misconfigured policies, and customer troubleshooting needs.
Requirements
- Experience with a statically typed compiled language such as Go, Rust, C++, or Java, with Go preferred.
- Frontend engineering experience with TypeScript, React, HTML, and CSS.
- Experience working with AI or large language models and their edge cases.
- Ability to define system behavior, design thoughtful abstractions, and consider retries, limits, and costs.
- Preferred experience with AI platforms or inference infrastructure, API gateways, usage limits or quotas, billing-adjacent systems, or customer-facing observability tools.
Benefits
- Full-time employees receive fully covered employee health, dental, and vision premiums, with half of dependent premiums covered, plus mental health and well-being support.
- 401(k) matching is 100% up to 3% of salary and 50% up to an additional 2%.
- Open flexible vacation policy, parental leave of up to 16 weeks for birth parents and 8 weeks for new parents, and bi-annual reviews.
- Annual professional development and home office/desk stipends, plus a coworking space stipend.
- Remote work outside the Bay Area; hybrid work near San Francisco with office attendance on Tuesdays and Wednesdays; onsite San Francisco employees receive lunch two or more times weekly.
- Company offsites are held twice per year.
Tech Stack
Categories
About ngrok Inc.
ngrok builds a unified ingress platform that lets developers expose, secure, and route traffic to services running anywhere—from local dev to production. It sells cloud software and subscriptions used for secure tunneling, API delivery, and AI gateway controls, replacing ad‑hoc proxies and VPNs. Founded in 2015 and headquartered in San Francisco, the privately held company is used by teams at companies such as GitHub, Okta, Microsoft, Zoom, and Twilio.