GrepJob
Handshake

Senior Software Engineer, AI Infrastructure

Handshake
Apply
2 months ago

Base Salary

$176k - $220k/yr

Responsibilities

  • Architect and build the core agent orchestration layer, including tool use, memory, and multi-step reasoning systems.
  • Design evaluation, observability, and reliability frameworks for safe, auditable, production-ready agent behavior.
  • Establish engineering standards for agentic development across platform teams.
  • Partner with ML, product, and platform engineers to ship agent-powered features from infrastructure through production.

Requirements

  • 4–7 years of backend engineering experience with strong proficiency in Node.js, TypeScript, and/or Python.
  • Experience designing and operating distributed systems at significant scale for developer experience.
  • Hands-on experience with LLM orchestration frameworks such as LangChain or LlamaIndex.
  • Deep understanding of agent architectures, including tool use, multi-step reasoning, memory management, and evaluation.
  • Experience with AWS, GCP, or Azure and infrastructure-as-code tools such as Terraform.
  • Experience with Node.js, JavaScript, CI/CD, and Docker.
  • Track record of shipping production systems with high reliability, low latency, and strong observability.
  • Strong communication skills and ability to drive alignment across engineering and cross-functional partners.
  • Open-source contributions to LLM or agent frameworks are a bonus.
  • Prior experience at an AI-native company or dedicated AI platform team is a bonus.

Benefits

  • Equity in a fast-growing company; 401(k) match; competitive compensation and financial coaching; paid parental leave, fertility benefits and parental coaching; medical, dental and vision coverage; mental health support; $500 wellness stipend; $2,000 learning stipend; internet and commuting support; free lunch and gym access in the San Francisco office; flexible PTO, 15 holidays and 2 flex days; team outings and referral bonuses; benefits apply to full-time US employees.