10 hours ago
London, United KingdomStaff+
Responsibilities
- Research and implement techniques for accelerated evaluation creation, including automated task synthesis, programmatic verifiers, and model-assisted rubric induction.
- Build pipelines that mine execution logs, agent traces, and runtime artifacts into high-fidelity evaluations and training data.
- Design and scale benchmarks for complex, long-horizon agentic reasoning across code, mathematics, and specialized domains.
- Build platform software that automates quality gates, including AutoRaters and automated loss-pattern root-cause analyzers.
- Provide technical direction and architecture across AI Data and partner organizations while aligning distributed engineering teams.
Requirements
- Bachelor's degree or equivalent practical experience.
- 8 years of experience programming in C++, Java, Python, Kotlin, or Go.
- 5 years of experience testing and launching software products.
- 3 years of experience with software design and architecture.
- Experience integrating generative AI tools or LLM interfaces into workflows.
- Preferred: Master's degree or PhD in Engineering, Computer Science, or a related technical field.
- Preferred: 8 years of experience with data structures and algorithms.
- Preferred: 3 years leading project teams and setting technical direction.
- Preferred: 3 years working in complex, matrixed organizations involving cross-functional or cross-business projects.
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.