3 hours ago
Seattle, WA, USASenior / Staff+
Base Salary
$140k - $225k/yr
Responsibilities
- Build and maintain backend services for the LLM gateway, including routing, rate limiting, key management, and observability.
- Contribute to sandboxing and isolation infrastructure for safely executing agent-generated code.
- Support Kubernetes-based platform services, including operators and autoscaling logic near the inference platform.
- Write high-performance backend code in Go, Rust, or async Python using FastAPI or Starlette, with Envoy and gRPC infrastructure.
- Instrument services with OpenTelemetry to monitor behavior, latency, and cost as the platform scales.
- Collaborate across gateway, sandbox, and inference platform teams while contributing to client engagements and internal platform capabilities.
- Provide technical direction and architectural ownership for reliable model serving and evaluation systems.
Requirements
- 4+ years of backend engineering experience covering distributed systems, API design, and production experience with Go, Rust, or async Python.
- Exposure to Kubernetes and containerization.
- Familiarity with LLM backend concerns such as rate limiting, caching, and token accounting is preferred but not required.
- Ability to work across multiple platform concerns and grow into specialization in gateway, sandbox, or inference infrastructure.
- Strong collaboration, emotional intelligence, learning mindset, judgment under ambiguity, and support for colleagues' success.
- Experience in startup and enterprise environments is preferred.
- Experience in energy, real estate, utilities, climate, or related fields is preferred.
- Additional experience with web frameworks, lower-level languages, networking paradigms, ML capabilities, graph or vector databases, DevOps tooling, or generative AI is a strong plus.
- Applicants must be authorized to work full-time in the United States; employment visa sponsorship is unavailable.
Benefits
- Competitive startup compensation based on capabilities, experience, and location, plus bonus eligibility and equity.
- Health insurance with meaningful dependent coverage.
- Flexible paid time off.
- Fully remote culture for applicants in the United States or Canada, with a Seattle-area teammate cluster.
- Training and learning opportunities.
- Travel to the Seattle area for the final interview and twice yearly for company summits.
- Mission-driven work with a profitable, fast-growing public benefit corporation and industry-leading clients.
Tech Stack
Categories
About AZX
Tech transformation, societal shifts and environmental disruption put enormous pressure on critical industries like energy, infrastructure, real estate and others to adapt, pursue new growth opportunities and optimize operations. AZX was created to meet these challenges head-on. We deliver AI transformation for critical industries providing strategy, execution and acceleration solutions. We prioritize code over powerpoint, applying start-up principles to challenge conventional thinking and develop strategic AI technology and business solutions that can be implemented quickly. We are mission-driven and client-centric, solving hard problems and building value for people, organizations and the planet. We are AZX.