Staff ML Ops Engineer

1 day ago

Base Salary

$213k - $272k/yr

Responsibilities

Own the end-to-end model lifecycle, including packaging, model CI/CD, serving, versioned contracts, automated deployment and rollback, monitoring, and drift detection.
Operate LLM, VLM, and agentic workloads with version-pinned models and prompts, generative evaluation, regression suites, guardrails, jailbreak and refusal monitoring, and token cost and latency observability.
Create secure, observable, self-serve paths for model deployment and encode operational and on-call safeguards into the platform.
Define and own the API contract boundary between the model platform and application backend.
Set technical standards, provide technical leadership, and mentor engineers working on productionization.

8+ years of engineering experience with deep ML infrastructure or MLOps experience, including operating a production model deployment, serving, and monitoring platform.
Hands-on production experience with LLM or VLM workloads, including serving or managed-provider integration, prompt and version management, generative evaluation, guardrails, and token cost and latency control.
Experience designing self-serve ML deployment systems with model registries and packaging, model CI/CD, serving contracts, rollback, and drift or quality monitoring.
Strong systems and API design judgment across polyglot service boundaries, including security, observability, and on-call trade-offs.
Track record of setting technical direction and leveling up engineers; formal people management is not required.
Bachelor's or master's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Preferred: computer vision or video model inference at scale, GPU serving, latency and cost optimization, Kubernetes or Argo, building an ML platform from zero, edge deployment such as NVIDIA Jetson, and agentic or generative tooling such as LangGraph, MCP frameworks, vector databases, and inference or serving platforms.

Full-time benefits include comprehensive health, dental, and vision coverage.
401(k) retirement benefits with a match of up to 4%.
Flexible paid time off and an employee equity program.
Bonus structure tied to meeting goals.
Applicants must be authorized to work in the U.S. and must pass a drug screening and background check; some roles may also require a federal background check and fingerprinting.

501-1,000 employees