19 hours ago
Base Salary
$224k - $308k/yr
Responsibilities
- Build an agent harness for planning, tool use, memory, context compaction, interruption, recovery, approvals, and long-running work.
- Integrate OpenAI and Anthropic model APIs and select models based on measured quality, latency, cost, and failure handling.
- Connect the harness to AWS workflow execution and approval state while keeping authorization and sensitive writes behind application policy checks.
- Build evaluation datasets, replay tests, quality metrics, and regression tests for agent findings, access decisions, application setup, and onboarding.
- Test prompt injection, stale evidence, conflicting instructions, unsafe tool use, and tenant-boundary protection in retrieval and memory.
- Improve prompts, retrieval, tools, and model routing, and evaluate fine-tuning or post-training methods when justified and approved.
- Set product engineering direction and implement shared components that help the team ship faster.
Requirements
- Strong Python engineering skills and experience shipping an LLM application that uses tools.
- Hands-on experience building agent workflows or evaluation systems for tool-using LLM applications.
- Experience with agent harnesses or equivalent implementations such as Claude Agent SDK, OpenAI Codex SDK, Strands Agents, LangChain Deep Agents, or LangGraph.
- Experience integrating model APIs, structured outputs, and asynchronous services, particularly with OpenAI or Anthropic.
- Depth in agent execution or evaluation systems, including working code and explainable failure analysis.
- Ability to distinguish plausible model responses from supported findings or verified actions.
- Preferred qualifications include open-source contributions, agent observability, security evaluations, synthetic evaluation data, fine-tuning, preference data, post-training evaluation, model distillation, and identity or security workflow experience.
Benefits
- Annual base salary for candidates in the San Francisco Bay Area is $224,000-$308,000, with equity where applicable, bonus, health, dental and vision insurance, 401(k), flexible spending account, and paid leave including PTO and parental leave.
- The role includes an immersive, in-person onboarding experience; the posting also references Okta's global community and more than 20 offices worldwide.
- Okta provides equal employment opportunity and reasonable accommodation support during application, interview, and onboarding processes.
Tech Stack
Categories
About Okta
Okta builds cloud-based identity and access management for enterprises and developers, including single sign-on, multi-factor authentication, and lifecycle management. It sells subscription SaaS as the Okta Workforce Identity and Customer Identity Clouds; the latter incorporates Auth0, acquired in 2021. Founded in 2009 and headquartered in San Francisco, Okta is a public company traded on Nasdaq.