Staff AI Engineer, Agentic AI Harness & Quality - Moveworks
ServiceNow2 days ago
Responsibilities
- Develop software and compound AI systems that improve the customer-facing agentic AI platform.
- Increase agent success rates and reduce agent misbehavior in customer environments.
- Build AI harness capabilities including cognitive architectures, evaluation benchmarks, context engineering, generative UI, dynamic orchestration, multimodal input/output, multilinguality, conversational memory, reasoning strategies, grounding, verifiability, deployment safety, and automatic optimization.
- Research and develop scalable solutions using current AI research, open-source repositories, large language models, and machine learning fundamentals.
- Evaluate improvements through experiments and productionize solutions at scale.
- Partner with web and chat platform engineering teams to turn harness improvements into user-facing experiences.
- Ship production-quality, fully unit-tested code and rigorously evaluated model, prompt, context-curation, and other tunable-system updates.
Requirements
- Experience building AI-native products and platforms as a software engineer.
- Strong understanding of LLM and agent evaluation fundamentals, including action trajectories, generated text, and non-uniform sampling.
- High standards for evaluation-dataset quality and attention to detail.
- Thoughtfulness about API contracts and exposing platform features to different stakeholders and end users.
- Ability to program in Python and/or Golang in a Mac development environment.
- Familiarity with industry-standard agent architectures and large language models.
- Ability to identify and correct subtle English-language instruction and communication bugs using precise writing and evaluations.
- Strong ownership, curiosity, willingness to learn, and ability to complete challenging projects quickly.
- Ability to build production-grade, unit-tested software and deliver continuous product improvements.
Benefits
- Regular employee position with a required-in-office work persona in North America and Canada.
- ServiceNow offers flexible work personas depending on the nature of the work and assigned location.
- Inclusive equal-opportunity workplace with reasonable-accommodation support.
Categories
About ServiceNow
ServiceNow builds a cloud platform for enterprise digital workflows, covering IT service management, customer service, HR service delivery, security operations, and operations management, plus tools for custom app development. It sells subscription SaaS to large organizations and public-sector agencies to automate processes and connect data across systems. Founded in 2004 and headquartered in Santa Clara, California, ServiceNow is a public company listed on the NYSE under the ticker NOW.