Google

Software Engineer, Automatic Prompt Optimization, AI Answers Quality

Google
Apply
2 days ago
Mountain View, CA, USA or New York, NY, USAMid Level
H1B sponsor

Base Salary

$147k - $210k/yr

Responsibilities

  • Design reward objectives balancing factuality, helpfulness, and overall response quality.
  • Build automated workflows to audit search prompts and identify continuous factuality improvements.
  • Facilitate large-model upgrades and orchestrate fine-tuning focused on factuality.
  • Analyze complex loss patterns using factuality taxonomies to deliver targeted quality improvements.
  • Write product or system development code.

Requirements

  • Bachelor’s degree or equivalent practical experience.
  • At least 2 years of software development experience in one or more programming languages.
  • At least 1 year of experience with LLMs and building quality.
  • At least 1 year of experience building and deploying production recommendation system models involving retrieval, prediction, ranking, personalization, search quality, or embeddings.
  • Experience integrating generative AI tools or LLM interfaces into workflows.
  • Preferred: 2 years of experience with data structures and algorithms.
  • Preferred: experience with statistical inference, confidence intervals, hypothesis testing, prompt engineering, LLM evaluation, ranking losses, and win-loss pattern analysis.
  • Preferred: experience balancing precision, recall, latency, and accuracy in prompt architectures and developing accessible technologies.

Benefits

  • Equity and benefits are provided.
  • The role includes a 15% bonus target.
  • US base pay is listed separately in the compensation section.

Categories

Google

About Google

10,000+ employees

Google builds consumer and enterprise software and services including Search, Android, YouTube, Chrome, Maps, Gmail, and Google Cloud. Its business model centers on digital advertising and paid cloud, software, and hardware offerings (e.g., Pixel and Nest) for consumers, developers, and organizations. Founded in 1998 and headquartered in Mountain View, California, Google operates globally as a subsidiary of Alphabet Inc.

Contact me