5 months ago
Base Salary
$160k - $250k/yr
Responsibilities
- Lead development of the core agent intelligence layer for multi-step workflows across CAD, CAE, and PLM software.
- Serve as technical lead for a small team of AI engineers, a user researcher, and domain expert contractors.
- Define agent capabilities from user stories, implement them, and benchmark performance against real workflows.
- Develop evaluation infrastructure, establish baselines, analyze failure modes, and improve task completion and cost efficiency.
- Set per-task token budgets and track cost per completed workflow.
- Own agent architecture decisions involving tool calling, state management, error recovery, model routing, and context management.
- Conduct user story mapping and validation through interviews and collaboration with domain experts.
- Write production code, review designs, unblock team members, and raise engineering standards.
- Collaborate with integrations, product, and customers during proofs of concept.
Requirements
- 7+ years of software engineering experience, including at least 2 years building agentic LLM-based agents for real-world, multi-step workflows.
- Deep experience designing LLM application architectures, including model selection, context management, retrieval strategies, tool-calling frameworks, and orchestration patterns.
- Strong evaluation and benchmarking experience for agentic systems, including task completion, cost efficiency, and failure-mode analysis.
- Proven experience shipping AI systems with measurable outcomes rather than demonstrations alone.
- Strong Python skills and hands-on experience with LLM tooling, function calling, tool-use APIs, tracing or observability tools such as Logfire or LangSmith, and evaluation frameworks.
- Experience leading a small technical team of 3–6 engineers, including setting direction, conducting code reviews, and driving architecture decisions.
- Preferred: experience with desktop automation, COM, or programmatic application control beyond web APIs.
- Preferred: background in mechanical engineering, CAD/CAE, PLM, or adjacent industries.
- Preferred: familiarity with enterprise deployment constraints on locked-down corporate workstations.
- Preferred: published work, open-source contributions, or public benchmark contributions related to agentic AI systems.
Benefits
- $160,000–$250,000 USD annual salary depending on experience.
- Equity participation in an early-stage Series A company.
- On-site work in San Francisco, California; this is not a remote role.
- Visa sponsorship is not available for this role.