8 hours ago
Remote, United StatesSenior / Staff+
H1B sponsor
Base Salary
$110k - $325k/yr
Responsibilities
- Design and build an optimization harness for evaluating, benchmarking, and improving AI agents across software engineering workflows.
- Develop Reddit-specific evaluation environments for measuring agent performance on meaningful engineering tasks.
- Build systems for offline replay, automated evaluation, synthetic task generation, regression detection, and human-in-the-loop feedback.
- Design model routing and orchestration strategies optimized for quality, latency, reliability, and cost.
- Define metrics and experimentation frameworks measuring developer productivity and engineering velocity.
- Build tooling to analyze agent behavior, investigate failures, and accelerate iteration.
- Partner with Platform Engineering, Infrastructure, and Developer Productivity teams to integrate agent capabilities into engineering workflows.
- Help shape Reddit’s flexible, model-agnostic agent platform strategy.
Requirements
- 5–12+ years of engineering experience.
- Extensive experience building and shipping large-scale production software systems.
- Experience designing evaluation, experimentation, benchmarking, or measurement systems for AI, search, developer platforms, or complex distributed systems.
- Strong understanding of modern LLMs, AI agents, and the engineering systems required to deploy them effectively.
- Experience optimizing systems across quality, latency, reliability, and cost.
- Strong software engineering fundamentals and a commitment to production-quality systems.
- Ability to work independently in ambiguous environments and drive technical direction for strategic initiatives.
- Strong cross-functional collaboration skills across engineering, infrastructure, and platform organizations.
Benefits
- Comprehensive healthcare benefits and income replacement programs.
- 401(k) with employer match.
- Global benefits supporting workspace, professional development, and caregiving.
- Family planning support.
- Gender-affirming care.
- Mental health and coaching benefits.
- Flexible vacation and paid volunteer time off.
- Generous paid parental leave.
- US-based employees receive medical, dental, and vision insurance and additional vacation and parental leave benefits.
- The role may be eligible for restricted stock units and, depending on the position offered, commission.
- The posting may span more than one career level.
- Some interviews may be recorded, transcribed, and summarized by AI, with an option to opt out.
Categories
About Reddit
Reddit builds a social news and discussion platform organized into user-created forums (“subreddits”) for consumers, creators, and communities. It monetizes primarily through advertising tools for brands and self-serve advertisers, plus a Premium subscription; developers can access data via its API. Founded in 2005 and headquartered in San Francisco, Reddit became a public company on the NYSE in 2024 and hosts over 100,000 active communities.