Staff Engineer, Agentic AI

4 hours ago

Base Salary

$160k - $250k/yr

Responsibilities

Own agent task-success metrics, establish baselines, and improve completion rates across engineering workflows.
Design and build reproducible evaluation and benchmarking infrastructure based on validated user stories.
Measure token budgets, workflow costs, task completion, and failure modes.
Interview engineers with research and domain teammates, document workflows, and translate validated stories into benchmarks.
Set agent architecture for tool calling, state management, error recovery, model routing, and context management.
Lead a small AI engineering team while writing production code, reviewing designs, and unblocking teammates.
Collaborate with product, integrations, and customers on proof-of-concept projects.
Prioritize workflow coverage based on customer value and technical feasibility.

At least 7 years of software engineering experience, including 2 or more years building LLM-based agents that take real-world actions.
Strong Python skills and deep experience with LLM application architecture, including model selection, retrieval, context management, orchestration, and tool calling.
Experience building rigorous agent evaluation and benchmarking systems that measure task completion, cost, and failure modes.
Technical leadership experience on a small engineering team with continued production software contributions.
Experience shipping AI or LLM tools using proprietary engineering data or desktop engineering software.
Familiarity with function calling, tool APIs, tracing or observability, and evaluation tools.
Experience with desktop automation or application APIs such as COM.
Background in mechanical engineering software, CAD, CAE, PLM, or an adjacent domain.
Understanding of deployment constraints on managed enterprise workstations.