GrepJob
7 months ago
New York, NY, USAMid Level / Senior
H1B Sponsor

Base Salary

$250k - $300k/yr

Responsibilities

  • Design and implement agent improvements end-to-end.
  • Build robust evaluation pipelines for the agent.
  • Productionize applied LLM techniques.
  • Improve core backend systems for reliability and scalability.
  • Partner with product and infra to define success metrics.
  • Write clean, well-tested code and document design decisions.

Requirements

  • 4+ years of backend engineering experience, preferably in Python.
  • Hands-on LLM experience including prompt engineering and evaluation design.
  • Track record of building evaluation harnesses to drive improvements.
  • Solid understanding of distributed systems fundamentals.
  • Pragmatic experimentation skills from hypothesis to rollout.
  • Excellent debugging and instrumentation skills.

Benefits

  • Competitive salary and meaningful equity.
  • Comprehensive benefits and flexible work setup.

Tech Stack

DatadogPostgreSQLPythonRedis

Categories