5 months ago
Base Salary
$350k - $850k/yr
Responsibilities
- Conduct cross-layer investigations into throughput, latency, and reliability gaps, identify root causes, and quantify the value of improvements
- Own and improve correctness evaluations across hardware platforms, numerics, and serving configurations, including regression investigations
- Build observability, dashboards, and modeling tools for fleet performance, cost, reliability, and correctness
- Partner with kernel, serving, routing, autoscaling, and capacity teams to prioritize and implement optimizations
- Rank opportunities by impact and effort and focus engineering work on the highest-leverage improvements
Requirements
- Hands-on experience with profiling, roofline analysis, latency and throughput optimization, and root-cause investigation in complex production systems
- Proficiency in Python and ability to read, instrument, and contribute to large production codebases
- Solid data analysis skills using SQL, pandas, or similar tools
- Ability to communicate quantitative results clearly in writing and influence teams without direct management authority
- Interest in correctness engineering, numerics, evaluation design, and regression detection
- Experience with ML systems, training or inference infrastructure, or LLM serving stacks is preferred
- Familiarity with GPU, TPU, and accelerator performance concepts such as memory bandwidth, kernel overheads, quantization, and collective communication is preferred
- Experience with high-throughput service reliability, autoscaling, load balancing, request routing, or tail latency is preferred
- Experience with model evaluation, numerical regression detection, distributed-systems observability, or telemetry is preferred
Benefits
- Hybrid work policy requiring staff to be in an office at least 25% of the time, with some roles requiring more office time
- Visa sponsorship may be available, with immigration-lawyer support
- Competitive compensation and benefits
- Optional equity donation matching
- Generous vacation and parental leave
- Flexible working hours
- Office space for collaboration
Categories
About Anthropic
Anthropic builds large language models and the Claude AI assistant for developers and enterprises, offered via API access and enterprise plans. Founded in 2021 and headquartered in San Francisco, it distributes Claude through its own platform and via partners such as Amazon Bedrock and Google Cloud’s Vertex AI. Its work emphasizes model reliability, interpretability, and practical tooling for tasks like coding assistance, analysis, and customer support automation.