1 day ago
Base Salary
$207k - $300k/yr
Responsibilities
- Design and optimize distributed evaluation execution engines for high-throughput, low-latency inference across TPU and GCU pools.
- Build foundational abstractions for LLM agent loops, tool use, and automated LLM-as-a-judge rating systems.
- Develop error classification, automated retry policies, and observability dashboards for evaluation pipelines.
- Partner with research scientists and data science teams to translate frontier-model evaluation requirements into scalable infrastructure.
- Mentor engineers and advocate rigorous code quality, testing, and system design practices.
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, Mathematics, or a related STEM field, or equivalent practical experience.
- At least 5 years of experience coding in one or more general-purpose languages such as Python, Java, C, or C++.
- At least 5 years of experience designing and launching large-scale production software products or foundation AI systems.
- At least 4 years of software development experience.
- At least 3 years of experience leading software design and system architecture for high-throughput distributed systems, foundation model runtimes, or client applications.
- Preferred: Master’s degree or PhD in Computer Science, Artificial Intelligence, Robotics, or a related technical field.
- Preferred: 5 years of technical leadership experience setting technical direction and guiding project teams.
- Preferred: 3 years of experience driving complex cross-functional initiatives across research, engineering, product management, and UX design.
- Preferred: experience developing, evaluating, or serving large language models, agentic workflows, multimodal pipelines, or AI runtime APIs.
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.