Senior Staff ML Engineer, AI Safeguards - Moveworks
ServiceNow15 hours ago
Responsibilities
- Design, build, and ship safeguards in the agent harness for prompt injection, jailbreaks, toxicity, sensitive topics, and sensitive data exposure.
- Build evaluations using customer reports, adversarial testing, and production traffic to measure true and false positives.
- Partner with Security to turn adversarial findings into evaluation cases, mitigations, and fixes.
- Select, integrate, and fine-tune detection models across commercial and government environments.
- Balance safeguard quality, latency, and cost for controls running in the request path.
- Build configurable safeguard policies for customer handling of sensitive topics.
- Monitor safeguard behavior in production and resolve regressions.
Requirements
- Typically 8 or more years of experience building production software, including 3 or more years of applied ML training, evaluating, and deploying models in production systems.
- Hands-on experience developing LLM safeguards such as guardrail models, content classifiers, prompt-injection or jailbreak detection, or safety evaluations.
- Strong model evaluation fundamentals for agent trajectories and text classification, with attention to training and evaluation data quality.
- Working knowledge of safeguard bypasses, including indirect prompt injection through tools and documents and multi-turn jailbreaks.
- Excellent Python experience.
Benefits
- Regular employee position.
- Required to work in the office under the assigned work persona.
- Distributed work flexibility and trust-based work personas may apply depending on work nature and location.
- Equal opportunity and reasonable accommodation support are provided.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.