Senior Staff ML Engineer, AI Safeguards - Moveworks
ServiceNow21 hours ago
Responsibilities
- Design, build, and ship agent-harness safeguards for prompt injection, single- and multi-turn jailbreaks, toxicity, sensitive topics, and sensitive data exposure.
- Build evaluations measuring safeguard true-positive and false-positive efficacy using customer reports, adversarial testing, and production traffic.
- Partner with Security to convert adversarial findings into evaluation cases, fixes, and mitigations.
- Select, integrate, and fine-tune detection models across commercial and government environments.
- Balance safeguard quality, latency, and cost for controls running in the request path.
- Build configurable safeguard policies and monitor production behavior to resolve regressions.
Requirements
- Typically 8 or more years of production software development experience, including 3 or more years of applied ML training, evaluation, and production deployment.
- Hands-on experience developing LLM safeguards such as guardrail models, content classifiers, prompt-injection or jailbreak detection, or safety evaluations.
- Strong model-evaluation fundamentals for agent trajectories and text classification, with attention to training and evaluation data quality.
- Working knowledge of safeguard bypasses, including indirect prompt injection through tools and documents and multi-turn jailbreaks.
- Excellent Python experience.
Benefits
- Regular employee position in the AMS North America and Canada region.
- Required-in-office work persona; ServiceNow uses flexible, remote, or office-based work personas depending on role and location.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.