7 hours ago
Base Salary
$160k - $250k/yr
Responsibilities
- Lead development of the core agent intelligence layer for multi-step workflows across desktop engineering software.
- Own the product loop from user stories and agent capability definition through implementation and real-workflow benchmarking.
- Define evaluation frameworks, baselines, completion metrics, token budgets, and cost-per-workflow tracking.
- Build rigorous, reproducible evaluation infrastructure grounded in validated user stories.
- Own agent architecture decisions involving tool-calling strategies, state management, error recovery, model routing, and context management.
- Lead user story mapping and validation through engineer interviews and domain-expert collaboration.
- Serve as a player-coach by writing production code, reviewing designs, unblocking the team, and raising engineering standards.
- Lead a small team and collaborate with integrations, product, and customers during proof-of-concept work.
Requirements
- 7+ years of software engineering experience, including at least 2 years building LLM-based agents that take real-world actions.
- Deep experience designing LLM application architectures, including model selection, context and window management, retrieval, and orchestration patterns.
- Proven ability to build evaluation and benchmarking frameworks for task completion, cost efficiency, and failure modes.
- Strong Python skills and hands-on familiarity with function calling, tool APIs, observability and tracing, and evaluation frameworks.
- Experience shipping AI or LLM tooling on proprietary engineering data or desktop engineering software, including agents or MCP servers over CAD, PLM, or simulation platforms.
- Technical leadership experience setting direction for teams of 3 to 6 engineers while writing and reviewing production code.
- Experience with desktop automation or programmatic application control such as COM or similar interfaces.
- Familiarity with mechanical engineering, CAD, CAE, PLM, or adjacent engineering software industries.
- Understanding of enterprise deployment constraints on locked-down corporate workstations.
- Comfort working in a fast-paced, high-intensity early-stage environment with significant customer demand.
Benefits
- Base salary of $160,000 to $250,000 USD annually plus equity.
- On-site work in San Francisco, California, United States.
- Visa sponsorship is not available for this role.