3 months ago
San Francisco, CA, USAMid Level
Base Salary
$165k - $210k/yr
Responsibilities
- Design and build a low-latency, chat-like interface for users to test large language models.
- Develop the developer console for API-key generation, budget limits, and real-time usage graphs.
- Integrate Stripe or similar services for subscription billing, payment webhooks, pro-rating, and tiered plans.
- Create a dynamic API reference and documentation portal.
- Write client-side CLI and SDK wrappers for connecting to API endpoints.
- Build secure backend API gateways and low-latency streaming solutions.
- Work across C++, Python, runtime execution, and distributed infrastructure with ML researchers and systems engineers.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
- At least 3 years of software engineering experience with a focus on frontend development.
- Strong proficiency in TypeScript and Python.
- Understanding of responsive design and UX fundamentals.
- Strong collaboration and communication skills across engineering and ML teams.
- Comfort working from the office in a fast-moving, high-ownership environment.
- Preferred: experience with ML systems engineering or inference engines such as vLLM, Sglang, or TRT-LLM.
- Preferred: knowledge of WebSockets, Server-Sent Events, jittery network streams, and responsive streaming interfaces.
- Preferred: experience with Stripe Elements, payment webhooks, SaaS billing logic, pro-rating, and subscription tiers.
- Preferred: experience rendering API specifications into readable web pages and reading FastAPI or vLLM backend code.
Benefits
- Medical, dental, and vision insurance.
- 401(k) plan.
- Daily lunch, snacks, and beverages.
- Flexible time off.
- Competitive salary and equity.
- Office-based work arrangement; the posting does not specify a contract or internship duration.
Tech Stack
Categories
