Google

Senior Staff Software Engineer, AI Agent Platform, Vertex

Google
Apply
8 hours ago
Warsaw, PolandStaff+

Responsibilities

  • Architect, develop, and maintain scalable APIs and backend infrastructure for generative AI workloads.
  • Optimize routing, load balancing, quota management, and data-plane mechanisms connecting user requests to ML serving clusters across TPU and GPU fleets.
  • Prototype and launch API products that expose advances in Google foundation models.
  • Collaborate with ML researchers, ML serving teams, and product managers to translate AI capabilities into reliable enterprise APIs.
  • Define and implement API security, high availability, fault tolerance, and observability practices across distributed systems.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • 8 years of experience in software development.
  • 7 years of experience leading technical project strategy, ML design, and ML infrastructure work such as model deployment, evaluation, data processing, debugging, and fine-tuning.
  • 5 years of experience in systems architecture and large-scale serving infrastructure.
  • Experience delivering technical solutions in changing environments and working on global initiatives in multinational or internationalized organizations.
  • Master’s degree or PhD in Engineering, Computer Science, or a related technical field is preferred.
  • 8 years of experience with data structures and algorithms is preferred.
  • 5 years of experience in a technical leadership role leading project teams and setting technical direction is preferred.
  • 3 years of experience with complex matrix organizations and cross-functional, cross-timezone, or cross-business projects is preferred.
  • Experience serving generative AI models using inference frameworks or hardware accelerators such as GPUs or TPUs is preferred.

Benefits

  • The role is based in Poland and includes company benefits, with additional bonus and equity eligibility stated in the posting.

Tech Stack

Google Cloud
Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me