4 hours ago
Base Salary
$160k - $250k/yr
Responsibilities
- Lead development of the agent intelligence layer for multi-step workflows across desktop engineering software.
- Provide technical leadership for a small team of AI engineers, a user researcher, and domain expert contractors.
- Own the product loop from user stories and agent capability definition through implementation and real-workflow benchmarking.
- Define evaluation frameworks, baselines, completion metrics, token budgets, and cost-per-workflow tracking.
- Build rigorous, reproducible evaluation infrastructure grounded in validated user stories.
- Make agent architecture decisions covering tool calling, state management, error recovery, model routing, and context management.
- Lead user story mapping and validation through interviews and collaboration with domain experts.
- Write production code, review designs, unblock the team, and raise engineering standards as a player-coach.
- Collaborate with integrations, product, and customers during proof-of-concept engagements.
Requirements
- 7+ years of software engineering experience, including at least 2 years building LLM-based agents that take real-world actions.
- Deep experience designing LLM application architectures involving model selection, context and window management, retrieval, tool calling, and orchestration patterns.
- Hands-on experience shipping AI or LLM tooling on proprietary engineering data or desktop engineering software such as CAD, PLM, or simulation platforms.
- Strong Python proficiency and familiarity with LLM function calling, tool APIs, observability and tracing, and evaluation frameworks.
- Experience building evaluation and benchmarking frameworks for task completion, cost efficiency, and failure modes.
- Technical leadership experience directing teams of 3 to 6 engineers, conducting meaningful code reviews, and continuing to write production code.
- Experience with desktop automation or programmatic application control through COM or similar interfaces.
- Background in mechanical engineering, CAD, CAE, PLM, or an adjacent engineering-software field.
- Familiarity with enterprise deployment constraints on locked-down corporate workstations.
- Public benchmarks, publications, or open-source agentic AI project contributions are a plus.
Benefits
- Base salary of $160,000 to $250,000 USD annually plus equity.
- Visa sponsorship is not available for this role.
- On-site work in San Francisco, California.