5 hours ago
Base Salary
$140k - $225k/yr
Responsibilities
- Manage open-weight model serving, including deployment, configuration, cold-start strategy, SLOs, upgrades, and canaries.
- Administer Kubernetes inference and sandbox workloads, including operators, CRDs, autoscaling, GPU scheduling and sharing, and node lifecycle.
- Deploy, back up, scale, and recover vector stores and graph stores with tested restore procedures.
- Own the sandbox runtime and host-side control plane, including lifecycle, execution, snapshots, forks, teardown, metering, and isolation threat modeling.
- Direct FastAPI control-plane services, Terraform/OpenTofu, Bicep, and dashboards.
- Provide the infrastructure layer used by backend services and debug into dependent services when needed.
- Maintain open-source engineering standards through reviewed pull requests, documentation, and reproducible builds.
Requirements
- At least 5 years of experience shipping production systems in Rust or another systems language such as Go, C, C++, or Zig, with willingness to work in Rust.
- Production experience operating Kubernetes workloads, including controllers or operators, scheduling, autoscaling, and node lifecycle.
- Strong ability to threat-model isolation boundaries and apply least privilege, credential isolation, audit trails, and human approval controls.
- Hands-on experience deploying or operating open-weight LLM serving infrastructure such as vLLM or SGLang in reliable, metered production endpoints.
- Experience diagnosing and improving distributed-system performance using measurable latency and optimization results.
- Practical experience with Rust and Tokio, Python/FastAPI, Kubernetes operators, controller-runtime, Kubebuilder, CRDs, KEDA, Karpenter, GPU device plugins, or DRA.
- Familiarity with Firecracker, Kata, gVisor or comparable isolation technologies, secrets management, egress control, vector stores, graph stores, backup, and failover.
- Experience operating across AWS, Azure, GCP, and managed GPU clouds using infrastructure as code and observability tooling.
- Applicants must be authorized to work full time in the United States; employment visa sponsorship is unavailable.
Benefits
- Competitive early-stage startup compensation based on capabilities, experience, and location.
- Bonus eligibility.
- Health insurance with meaningful dependent coverage.
- Flexible paid time off.
- Equity.
- Fully remote culture with teammates in Seattle.
- Travel required twice per year for company summits.
Tech Stack
Categories
About AZX
Tech transformation, societal shifts and environmental disruption put enormous pressure on critical industries like energy, infrastructure, real estate and others to adapt, pursue new growth opportunities and optimize operations. AZX was created to meet these challenges head-on. We deliver AI transformation for critical industries providing strategy, execution and acceleration solutions. We prioritize code over powerpoint, applying start-up principles to challenge conventional thinking and develop strategic AI technology and business solutions that can be implemented quickly. We are mission-driven and client-centric, solving hard problems and building value for people, organizations and the planet. We are AZX.