7 hours ago
Mountain View, CA, USAMid Level
H1B sponsor
Base Salary
$174k - $252k/yr
Responsibilities
- Design, build, and scale realistic agent environments and task suites.
- Develop agentic automated raters, calibrate them against human evaluations, and benchmark agent capabilities against frontier models.
- Enable agents to generate and iterate on verifiers such as automated test cases.
- Develop trajectory-analysis frameworks and diagnostic tools to identify agent failure modes and optimize agent harnesses.
- Harvest multi-turn interaction trajectories into datasets and reward signals for supervised fine-tuning and reinforcement-learning post-training of Gemini models.
Requirements
- At least 2 years of experience with agentic AI workflows, frameworks, and approaches.
- At least 1 year of experience with machine learning and deep learning.
- Experience in software engineering and cloud-based development.
- Experience with Python, TensorFlow, PyTorch, or similar machine-learning frameworks.
- Preferred: in-depth knowledge of machine-learning algorithms, including supervised learning and reinforcement learning.
Benefits
- Equity and benefits are provided.
- The role offers opportunities for learning, research collaboration, and contribution to the wider research community.
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.