19 hours ago
Base Salary
$194k - $267k/yr
Responsibilities
- Build agent harnesses for planning, tool use, memory, context compaction, interruption, and recovery during long-running work.
- Integrate OpenAI and Anthropic model APIs and select models based on measured quality, latency, and cost.
- Connect the agent harness to AWS workflow execution and approval state.
- Keep authorization and sensitive writes behind application policy checks and require evidence of resulting state before completion.
- Build evaluation datasets, replay tests, regression tests, and metrics for findings, access decisions, app setup, and AI agent onboarding.
- Test prompt injection, stale evidence, conflicting instructions, unsafe tool use, and tenant-boundary protection in retrieval and memory.
- Improve prompts, retrieval, tools, and model routing, and evaluate fine-tuning or other post-training methods when justified and approved.
- Lead a domain such as harnesses, evaluations, or model quality and implement its critical components.
Requirements
- Strong Python engineering skills and experience shipping an LLM application that uses tools.
- Hands-on experience building agent workflows or evaluation systems for tool-using LLM applications.
- Experience with agent tooling such as Claude Agent SDK, OpenAI Codex SDK, Strands Agents, LangChain Deep Agents, LangGraph, or a custom implementation.
- Experience integrating model APIs, structured outputs, and asynchronous services; OpenAI or Anthropic experience is especially relevant.
- Depth in agent execution or evaluation systems, including working code and explainable failure analysis.
- Ability to distinguish a plausible model response from a supported finding or verified action.
- Preferred experience includes open-source contributions, agent observability, security evaluations, synthetic evaluation data, fine-tuning, preference data, post-training evaluation, model distillation, identity and security workflows, or foundation-model research.
Benefits
- Annual base salary for San Francisco Bay Area candidates is $194,000–$267,000 USD, excluding equity and bonus.
- Benefits include health, dental and vision insurance, 401(k), flexible spending account, paid time off, and parental leave.
- The role includes an immersive, in-person onboarding experience.
- Okta supports well-being, social impact, talent development, and community connection.
Tech Stack
Categories
About Okta
Okta builds cloud-based identity and access management for enterprises and developers, including single sign-on, multi-factor authentication, and lifecycle management. It sells subscription SaaS as the Okta Workforce Identity and Customer Identity Clouds; the latter incorporates Auth0, acquired in 2021. Founded in 2009 and headquartered in San Francisco, Okta is a public company traded on Nasdaq.