Google

Senior Staff Software Engineer, AI Agent Platform, Vertex

Google
Apply
2 days ago
Warsaw, PolandStaff+

Responsibilities

  • Architect, develop, and maintain horizontally scalable APIs and backend infrastructure for Generative AI workloads.
  • Optimize routing, load balancing, quota management, and data-plane systems connecting API requests to ML serving clusters across TPU and GPU fleets.
  • Prototype and launch API products exposing Google’s foundation models.
  • Collaborate with ML researchers, ML serving teams, and product managers to deliver enterprise-grade APIs.
  • Define and implement API security, high availability, fault tolerance, and observability practices for distributed systems.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • At least 8 years of software development experience.
  • At least 7 years leading technical project strategy, ML design, and ML infrastructure work such as model deployment, evaluation, data processing, debugging, and fine-tuning.
  • At least 5 years of systems architecture and large-scale serving infrastructure experience.
  • Experience delivering technical solutions in changing environments and working on global initiatives in multinational or internationalized organizations.
  • Preferred: Master’s degree or PhD in Engineering, Computer Science, or a related technical field.
  • Preferred: 8 years of experience with data structures and algorithms.
  • Preferred: 5 years in a technical leadership role setting technical direction and leading project teams.
  • Preferred: experience with complex matrix organizations and cross-functional, cross-timezone, or cross-business projects.
  • Preferred: experience serving Generative AI models using inference frameworks or hardware accelerators such as GPUs and TPUs.

Benefits

  • Poland compensation is zł640000 - zł655000 PLN plus a 25% bonus target, equity, and benefits.
  • Google benefits are available; see the company benefits information for details.

Tech Stack

Google Cloud
Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me