OpenAI

Protection Scientist Engineer, Integrity

OpenAI
Apply
22 hours ago

Base Salary

$220k - $425k/yr

Responsibilities

  • Define protection strategy, priorities, roadmaps, and trade-offs for a harm area or product launch.
  • Build and maintain production harm-detection signals, classifiers, and pipelines using SQL, Python, machine learning, and language models.
  • Lead cross-functional execution by aligning specialists, resolving dependencies, and communicating recommendations and decisions.
  • Investigate exploitation, national security threats, coordinated misuse, and attempts to circumvent model safeguards.
  • Partner with Policy and Operations on review, escalation, enforcement, and intervention protocols.
  • Measure detection quality, remaining harm, and intervention effectiveness, using expert feedback and operational outcomes to improve systems.
  • Define monitoring and detection requirements for product and model launches, investigate gaps, and drive post-launch improvements.
  • Scale analytical, investigative, and operational work with language models, agents, reusable tools, documentation, and human oversight.

Requirements

  • Deep expertise in sextortion, trafficking, national security, jailbreaks, or a closely related harm domain.
  • Experience investigating adversarial behavior and translating incomplete, evolving evidence into actionable signals while managing false-positive risk.
  • Proficiency in SQL and Python, including writing reliable and efficient production code for detection and data processing.
  • Ability to apply quantitative analysis and machine-learning methods to measure risk and evaluate system effectiveness.
  • Experience setting strategy and delivering complex, cross-functional technical projects.
  • Clear and concise written and verbal communication, including explaining technical findings and trade-offs to varied audiences.
  • Ability to use language models and automation to scale analytical, investigative, or operational work with appropriate evaluation and human oversight.
  • Additional machine-learning, software-engineering, data-science, or measurement experience is a plus.

Benefits

  • The role is based in OpenAI’s San Francisco office.
  • Participation in an on-call rotation may require resolving urgent escalations outside normal working hours.
  • Some investigations may involve sensitive content, including sexual, violent, or otherwise disturbing material.

Tech Stack

Categories

OpenAI

About OpenAI

10,000+ employees

OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.

Contact me