24 hours ago
Base Salary
$207k - $300k/yr
Responsibilities
- Evaluate and model launch analysis.
- Collaborate cross-functionally on data collection, management, quality measurement, and improvements.
- Improve end-to-end evaluations using user and product feedback, including continuous production evaluation and verification for model releases.
- Analyze user feedback and provide insights to improve frontier models and user experiences.
- Solve complex, high-impact research and engineering challenges with non-obvious solutions.
Requirements
- Bachelor’s degree in Computer Science, Electrical Engineering, Mathematics, Statistics, a related technical field, or equivalent practical experience.
- Experience with machine learning, software engineering, Python programming, and data analysis tools and processes.
- Preferred Master’s degree or PhD in Engineering, Computer Science, or a related technical field, or equivalent practical experience.
- Extensive experience with evaluations and user feedback analysis.
- Experience with standard data analysis platforms and interactive notebooks such as Colab.
- Strong quantitative and engineering skills, including large-scale data analysis, autorater development, and human-in-the-loop quality improvements.
- Familiarity with LLM products and standard LLM evaluation and testing methodologies.
Benefits
- US base pay is $207000–$300000 USD, plus a 20% bonus target, equity, and benefits.
Tech Stack
Categories
AI ResearchData Science
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.