Machine Learning Engineer
Arena Intelligence, Inc.1 day ago
San Francisco, CA, USAMid Level
Responsibilities
- Architect and build core modeling systems for data and evaluation products.
- Own the full-stack data, model-training, and evaluation pipelines.
- Collaborate with researchers, engineers, and product leadership to turn ideas into reliable systems.
- Improve reproducibility, scalability, and support for new modalities in AI evaluation.
- Research state-of-the-art evaluation methods and contribute to the vision for a centralized evaluation platform.
- Support rapid product iteration and help establish a culture of feedback and quality.
Requirements
- Strong programming skills and the ability to work across a typical recommendation-system or LLM stack.
- Experience with deep learning, language models, or reward-model training.
- Experience with LLM fine-tuning, prompt engineering, and function calling.
- At least 4 years of industry experience or relevant projects.
- Solid understanding of statistics and methods for evaluating product-specific uncertainty.
- Self-motivation, ownership, and a passion for shipping quality products.
Benefits
- Competitive compensation aligned with the markets where team members are based, with the role-specific range listed on the posting.
- Comprehensive medical, dental, vision, and additional health and wellness support programs.
- Opportunity to work on cutting-edge AI with a small, mission-driven team.
- Culture emphasizing transparency, trust, and community impact.
Categories
About Arena Intelligence, Inc.
Created by researchers from UC Berkeley, Arena (formerly LMArena) is a community-powered platform to measure and advance the frontier of AI for real-world use. Tens of millions of builders, researchers, and creative professionals come to Arena to use frontier models and give feedback on their responses, shaping a public leaderboard grounded in real-world use.