Full-stack Software Engineer III/Senior, AI Gateway
ngrok Inc.16 days ago
Base Salary
$166k - $248k/yr
Responsibilities
- Build and evolve AI-aware gateway components that classify and handle AI traffic in real time.
- Design and implement AI Gateway Traffic Policy Objects for rate limits, usage caps, and access rules.
- Track AI requests, tokens, and related metadata accurately for customer usage visibility.
- Expose trustworthy signals explaining allowed and blocked traffic, applied policies, and accumulated usage.
- Create AI-specific gateway abstractions that hide provider quirks and infrastructure complexity.
- Collaborate with Gateway, Customer Data, and Platform teams to align usage data, policy enforcement, and billing signals.
- Develop frontend experiences using TypeScript, React, HTML, and CSS where needed.
Requirements
- Experience with a statically typed, compiled language such as Go, Rust, C++, or Java; Go is preferred.
- Frontend engineering experience with TypeScript, React, HTML, and CSS.
- Experience working with AI or large language models.
- Ability to design system behavior, thoughtful abstractions, and developer-friendly experiences.
- Extra credit for experience with AI platforms, inference infrastructure, API gateways, usage limits, quotas, billing-adjacent systems, or customer-facing observability tools.
- Candidates must be US-based and permanently authorized to work in the United States without current or future visa sponsorship.
Benefits
- Remote work outside the Bay Area or hybrid work near San Francisco, with Bay Area employees commuting Tuesdays and Wednesdays.
- Company-paid employee healthcare, dental, and vision premiums, with half of dependent premiums covered, plus mental health support.
- 401(k) matching of 100% up to 3% of salary and 50% up to another 2%.
- Open, flexible vacation policy.
- Up to 16 weeks of birth-parental leave and up to 8 weeks for other new parents.
- Annual professional development budget and home office/desk stipend.
- Co-working space stipend.
- Lunch provided at least twice weekly for employees onsite at the San Francisco office.
- Company offsites twice a year and bi-annual reviews.
Tech Stack
Categories
About ngrok Inc.
One gateway for all your traffic. ngrok replaces your networking hodgepodge—reverse proxies, load balancers, VPNs, auth layers, model routers, and the rest of the kludge—with one cloud networking platform. Secure, transform, and route traffic to services running anywhere. localhost to prod, APIs to AI models, and much more, already built by millions of developers and trusted by teams at Twilio, GitHub, Okta, Microsoft, Zoom, and Databricks.