5 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Architect, build, and maintain high-throughput, low-latency platform services and orchestration pipelines for automated evaluation, benchmarking, and metric computation.
- Design evaluation systems that detect metric drift, improve throughput, and scale model-assisted rating workflows such as LLM-as-a-judge and Autorater.
- Modernize and consolidate fragmented evaluation pipelines into a unified core platform with reusable and extensible frameworks.
- Optimize throughput, execution turnaround time, and resource efficiency for continuous, high-volume evaluation workloads.
- Integrate AI tooling, automated validation harnesses, and AI-assisted workflows into engineering practices.
Requirements
- Bachelor’s degree or equivalent practical experience.
- At least 5 years of software development experience in one or more programming languages.
- At least 3 years of experience working with embedded operating systems.
- At least 3 years of experience testing, maintaining, or launching software products.
- At least 1 year of experience with software design and architecture.
- Preferred: master’s degree or PhD in computer science or a related technical field.
- Preferred: 5 years of experience with data structures and algorithms.
- Preferred: 1 year of experience in a technical leadership role.
- Preferred: experience developing accessible technologies.
Categories
About Google
Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.