4 hours ago
Base Salary
$238k - $326k/yr
Responsibilities
- Implement intent-based enforcement to verify that agent runtime requests match their intended purpose.
- Apply LLM reasoning and prompt parsing to interpret prompts, tool payloads, and agent intent in real time.
- Integrate low-latency inference and semantic evaluation engines into API gateway request paths.
- Build embeddings, vector-search, zero-shot classification, and confidence-scored decision systems for agent-action alignment.
- Feed semantic verification results into policy frameworks such as Cedar.
- Establish evaluation benchmarks, prompt-injection defenses, guardrails, schema validation, and structured-output enforcement.
- Architect scalable ML and generative AI systems with retrieval, inference, and evaluation pipelines.
- Optimize prompting, context retrieval, and RAG workflows for Claude-based systems.
- Build automated production evaluation pipelines for model quality, correctness, groundedness, and safety.
- Mentor and coach engineers and help drive greenfield initiatives with product and engineering teams.
Requirements
- 10+ years of software development experience and strong programming expertise in Python; Go or TypeScript familiarity is a plus.
- Hands-on applied machine learning experience spanning feature engineering, model training, and fine-tuning.
- Hands-on experience with generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic.
- Deep understanding of retrieval-augmented generation, embeddings, and knowledge-base workflows.
- Experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or related AI agent frameworks.
- Familiarity with FastAPI, PyTorch, TensorFlow, Spark ML, and workflow orchestration tools such as Airflow.
- Experience defining evaluation metrics, pipelines, and feedback loops for ML and generative AI systems.
- Experience building tools or infrastructure for AI/ML applications and understanding the AI-native developer lifecycle.
- Bachelor’s or master’s degree in computer science or a related field.
- Experience integrating AI-driven systems with identity, authentication, or security products is preferred.
- Exposure to ethical AI, model risk, compliance frameworks, evaluation datasets, synthetic data generation, or LLM-as-a-judge methods is preferred.
Benefits
- Annual base salary range of $238,000–$326,000 for candidates located in the San Francisco Bay Area, excluding equity and bonus.
- Benefits include health, dental and vision insurance, 401(k), flexible spending account, and paid leave including PTO and parental leave.
- The role is associated with a hybrid work arrangement and includes immersive, in-person onboarding.
- Okta supports well-being, social impact, talent development, and community connection.
Tech Stack
Categories
About Okta
Okta builds cloud-based identity and access management for enterprises and developers, including single sign-on, multi-factor authentication, and lifecycle management. It sells subscription SaaS as the Okta Workforce Identity and Customer Identity Clouds; the latter incorporates Auth0, acquired in 2021. Founded in 2009 and headquartered in San Francisco, Okta is a public company traded on Nasdaq.