Member of Technical Staff, Evals & Post-Training Product
Fireworks AIabout 2 months ago
San Mateo, CA, USAMid Level / Senior
H1B Sponsor
Responsibilities
- Design and scale internal evaluation workflows for model quality assessment.
- Build and improve user-facing product workflows for fine-tuning models.
- Collaborate with customers and internal teams to understand evaluation needs.
- Support high-priority engagements and triage issues.
- Convert bespoke workflows into productized solutions.
Requirements
- 1 - 7 years of software engineering experience.
- Hands-on experience with LLM evaluations and post-training methods.
- Ability to work across backend systems and developer-facing products.
- Understanding of the GenAI lifecycle and its interconnected steps.
- User-centric mindset with willingness to engage with users.
Benefits
- Solve challenging problems at the forefront of AI infrastructure.
- Work with cutting-edge technology impacting global AI usage.
- Enjoy ownership and impact in a fast-growing team.
- Collaborate with world-class engineers and AI researchers.