4 days ago
San Francisco, CA, USA
Entry Level / Mid Level
Base Salary
$255k - $325k/yr
Responsibilities
- Build evaluation and data foundations for personalized multimodal AI systems.
- Collaborate with researchers to create rigorous evaluations and datasets.
- Design and implement human-data pipelines and experiment infrastructure.
- Develop frameworks for evaluating subjective and long-term behaviors.
- Create reproducible pipelines for processing multimodal signals.
- Define meaningful progress metrics and build systems for measurement.
- Work across teams to ensure technical soundness and human-centered design.
- Prototype and iterate on measurement frameworks for behavioral results.
Requirements
- Strong software engineering fundamentals and experience with data and backend systems.
- Excellent research judgment regarding measurement and metrics.
- Experience with human-in-the-loop systems and evaluation tooling.
- Rigorous approach to data quality and empirical correctness.
- Motivated by human-centered AI and measuring subtle behaviors.
- Desire to shape research infrastructure for new AI products.
Benefits
- Hybrid work model with four days in the office per week.
- Relocation assistance for new employees.
Categories
AI & MLBackendData Science