6 days ago
Responsibilities
- Design, build, and ship agent efficiency systems, cost and quality telemetry, smart model routing, durable and deferred execution, and continuous optimization.
- Measure cost and latency and convert findings into targeted engineering improvements.
- Shape the team’s efficiency roadmap and help set technical direction for enterprise agents in production.
- Benchmark efficiency techniques on open-source, first-party, and enterprise agent workloads without regressing accuracy.
- Partner with evaluation engineers, model-serving teams, and product teams to close optimization loops and deliver changes across Agent Platform.
Requirements
- Bachelor’s degree or equivalent practical experience.
- Two years of software development experience in one or more programming languages such as Go, C++, or Python, or one year of experience with an advanced degree.
- Two years of experience with machine learning, large language models, or applied AI.
- Preferred: master’s degree or PhD in Computer Science, Machine Learning, or a related technical field.
- Preferred: experience building, deploying, or optimizing LLM applications or agentic frameworks such as Agent Development Kit, LangGraph, or LangChain.
- Preferred: experience with model serving optimization, inference caching, model routing, or LLM cost and latency profiling.
- Preferred: experience instrumenting, benchmarking, or evaluating ML systems in production.
- Preferred: technical leadership, mentoring, or driving cross-team engineering initiatives.
Benefits
- The role includes a bonus target, equity, and Google benefits.
Categories
About Google
A problem isn't truly solved until it's solved for all. Googlers build products that help create opportunities for everyone, whether down the street or across the globe. Bring your insight, imagination and a healthy disregard for the impossible. Bring everything that makes you unique. Together, we can build for everyone. Check out our career opportunities at goo.gle/3DLEokh