22 hours ago
Base Salary
$220k - $425k/yr
Responsibilities
- Define protection strategy, priorities, roadmaps, and trade-offs for a harm area or product launch.
- Build and maintain production harm-detection signals, classifiers, and pipelines using SQL, Python, machine learning, and language models.
- Lead cross-functional execution by aligning specialists, resolving dependencies, and communicating recommendations and decisions.
- Investigate exploitation, national security threats, coordinated misuse, and attempts to circumvent model safeguards.
- Partner with Policy and Operations on review, escalation, enforcement, and intervention protocols.
- Measure detection quality, remaining harm, and intervention effectiveness, using expert feedback and operational outcomes to improve systems.
- Define monitoring and detection requirements for product and model launches, investigate gaps, and drive post-launch improvements.
- Scale analytical, investigative, and operational work with language models, agents, reusable tools, documentation, and human oversight.
Requirements
- Deep expertise in sextortion, trafficking, national security, jailbreaks, or a closely related harm domain.
- Experience investigating adversarial behavior and translating incomplete, evolving evidence into actionable signals while managing false-positive risk.
- Proficiency in SQL and Python, including writing reliable and efficient production code for detection and data processing.
- Ability to apply quantitative analysis and machine-learning methods to measure risk and evaluate system effectiveness.
- Experience setting strategy and delivering complex, cross-functional technical projects.
- Clear and concise written and verbal communication, including explaining technical findings and trade-offs to varied audiences.
- Ability to use language models and automation to scale analytical, investigative, or operational work with appropriate evaluation and human oversight.
- Additional machine-learning, software-engineering, data-science, or measurement experience is a plus.
Benefits
- The role is based in OpenAI’s San Francisco office.
- Participation in an on-call rotation may require resolving urgent escalations outside normal working hours.
- Some investigations may involve sensitive content, including sexual, violent, or otherwise disturbing material.
Categories
About OpenAI
OpenAI builds and deploys large-scale AI models and tools—including ChatGPT, GPT-4–class models, DALL·E, and Whisper—sold via APIs and enterprise subscriptions to developers and businesses. It monetizes through usage-based API pricing and ChatGPT Plus/Team/Enterprise, and also reaches customers via Microsoft’s Azure OpenAI Service. Founded in 2015 and headquartered in San Francisco, it operates as a private partnership.
