1 day ago
Base Salary
$262k - $364k/yr
Responsibilities
- Architect, build, and operate large-scale isolated and reproducible sandboxes for testing agent behaviors, tool calling, multi-turn workflows, and end-to-end workflows.
- Deliver reproducible evaluation infrastructure and automated test harnesses validating enterprise visibility, security, and compliance requirements.
- Design and scale platform infrastructure for online validation, offline auditing, and behavioral-pattern alerting in agentic systems.
- Build metrics engines and dashboards tracking evaluation coverage, semantic correctness, quality metrics, regression signals, and production health.
- Integrate evaluation runs into deployment pipelines and create release gates that prevent semantic and structural regressions before production deployment.
- Lead the engineering roadmap and integrate components from multiple product teams into an enterprise agent governance experience.
Requirements
- Bachelor's degree or equivalent practical experience.
- Eight years of software development experience.
- Seven years of experience leading technical project strategy, ML design, and optimization of industry-scale ML infrastructure.
- Five years of experience with software design and architecture, testing, and launching software products.
- Two years of experience with GenAI techniques or related concepts such as LLMs, multimodal systems, large vision models, language modeling, or computer vision.
- Preferred: ten years of experience leading scalable distributed systems, ML platforms, or observability infrastructure.
- Preferred: experience leading engineering teams and collaborating with product managers and researchers to translate scientific concepts into developer tools.
- Preferred: strong understanding of LLM execution mechanics, tool-calling APIs, and model-level failure analysis.
- Preferred: fluency in distributed tracing, semantic monitoring, and telemetry collection at scale.
- Preferred: experience shipping enterprise developer platforms, virtualization or sandbox environments, or production-grade test harnesses.
Benefits
- Google benefits are provided.
- The role is based in the United States and includes a 25% bonus target, equity, and benefits in addition to base pay.
About Google
A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh