30 days ago
San Francisco, CA, USAMid Level / Senior
Base Salary
$165k - $210k/yr
Responsibilities
- Design and build a low-latency, chat-like interface for testing large language models.
- Develop the developer console for API key generation, budget limits, and real-time usage graphs.
- Integrate Stripe or similar services for subscription billing, payment workflows, webhooks, tiers, and pro-rating.
- Create a dynamic API reference and documentation portal.
- Write CLI and SDK client-side wrappers for connecting to API endpoints.
- Build secure backend API gateways and low-latency streaming solutions.
- Collaborate with engineering, machine learning, and systems teams on developer experience and performance.
Requirements
- Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- 3+ years of software engineering experience with a focus on frontend development.
- Strong proficiency in TypeScript and Python.
- Understanding of responsive design and UX fundamentals.
- Strong collaboration and communication skills across engineering and ML teams.
- Comfort working from the office in a fast-moving, high-ownership environment.
- Preferred: experience with ML systems engineering and inference engines such as vLLM, Sglang, or TRT-LLM.
- Preferred: knowledge of WebSockets, Server-Sent Events, and handling unstable network streams without freezing the UI.
- Preferred: experience with Stripe Elements, payment webhooks, SaaS billing logic, API specification rendering, FastAPI, or vLLM backend codebases.
Benefits
- Medical, dental, and vision insurance.
- 401(k) plan.
- Daily lunch, snacks, and beverages.
- Flexible time off.
- Competitive salary and equity.
- Work from the office.
