6 hours ago
Base Salary
$207k - $300k/yr
Responsibilities
- Lead the architectural design of high-throughput serving infrastructure for evaluation workflows.
- Design scalable systems to store, process, and serve massive datasets for model evaluation.
- Optimize latency and resource efficiency for large-scale inference and evaluation pipelines.
- Collaborate with research teams to define infrastructure requirements for next-generation AI models.
- Establish technical roadmaps for data-serving platforms supporting DeepMind’s evaluation ecosystem.
- Lead complex architectural migrations and cross-team infrastructure projects.
Requirements
- Experience designing, building, and operating large-scale distributed systems focused on scalability, fault tolerance, and reliability.
- Experience in machine learning or AI infrastructure.
- Experience with software performance analysis and improvement and high-performance computer architectures, including CPU, memory subsystem, and multiprocessing concepts.
- Experience designing software architecture for applications, including AI/ML systems.
- Experience with site reliability engineering, system architecture, and distributed systems.
- Experience building developer tools such as compilers, test automation frameworks, or CI/CD systems.
- At least 8 years of experience with data structures and algorithms.
- Strong proficiency in C++ or Python.
- Experience developing and optimizing ML or production-serving infrastructure.
- Knowledge of VMs and sandboxed execution environments such as Xbox and Capsules.
- Understanding of current evaluation research and areas important to LLM research.
- Preferred: master’s degree or PhD in engineering, computer science, or a related technical field.
- Strong problem-solving, collaboration, and cross-organizational communication abilities.
Benefits
- US base pay is listed as $207000-$300000 annually, with a 20% bonus target, equity, and benefits.
- Benefits information is available through Google’s benefits program.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.