Software Engineer
Mechanize, Inc.7 months ago
Base Salary
$350k - $350k/yr
Responsibilities
- Design, build, and quality-assure reinforcement learning tasks consisting of prompts, environments, and automated graders.
- Own tasks through ideation, grading infrastructure, model evaluation, failure analysis, and iteration.
- Run frontier models against tasks and identify meaningful capability gaps, grader issues, and subtle model failures.
- Direct coding agents, evaluate their output, and determine when they fail.
- Contribute to shared infrastructure such as build-pipeline improvements, QA automation, and tooling for engineers.
Requirements
- Ability to code in Python.
- Strong technical fundamentals and intuition for AI model behavior.
- Extensive familiarity with what frontier coding agents can and cannot do.
- Ability to work independently at a consistent pace.
- Prior ML or AI experience is not required.
Benefits
- Health, dental, vision, and life insurance.
- Equity and performance bonuses are included in compensation.
- The role is based with a roughly 20-person team in San Francisco.
About Mechanize, Inc.
Mechanize builds reinforcement-learning environments that AI labs use to train and evaluate code-generation models, and licenses these environments as products and services. It primarily serves frontier AI research groups and model teams, providing tasks, benchmarks, and infrastructure tailored for coding agents. The privately held company is headquartered in San Francisco and has been covered by the New York Times; backers include Patrick Collison, Nat Friedman, Daniel Gross, Jeff Dean, and others.