Senior Staff Software Engineer
ServiceNow6 hours ago
Base Salary
$172k - $301k/yr
Responsibilities
- Own the Build Agent evaluation strategy and roadmap, including prompt-set design, scoring methodology, failure-mode taxonomy, and telemetry instrumentation.
- Lead evaluation infrastructure covering golden prompts, Pass@1 and functional scoring, failure categorization, and coverage across ServiceNow metadata types and UI workflows.
- Benchmark candidate foundation models against the production default and make data-backed model support recommendations.
- Track token usage, cache efficiency, inference cost, and correctness as release signals.
- Coordinate across contributing teams to define quality standards, prioritize coverage, and drive evaluation findings to owned fixes.
- Solve ambiguous cross-cutting problems involving evaluation signals, model capability, and platform architecture.
Requirements
- Direct experience building or leading evaluation systems for LLM-based products, including scoring methodology, benchmark design, and failure analysis.
- Understanding of coding-agent architecture, including tool use, agentic loops, context management, and generic versus domain-specific scaffolding.
- At least 6 years of experience with relevant technologies, advanced coding skills, and fluency in one or more of Java, C++, Ruby, Shell, or JavaScript.
- Experience critically evaluating foundation models and distinguishing capability differences from tuning or scaffolding artifacts.
- Ability to execute against ambiguous priorities while weighing context, risk, desired outcomes, and incomplete or contested evaluation data.
Benefits
- Base pay of $171,900–$300,800, plus equity when applicable and variable or incentive compensation.
- Health plans, flexible spending accounts, a 401(k) plan with company match, ESPP, matching donations, flexible time away, and family leave programs.
- Flexible work persona within ServiceNow’s distributed work model; the role is a regular employee position in North America and Canada.
Tech Stack
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.