Senior | Staff Software Engineer - AI / ML
Snorkel AI3 days ago
Base Salary
$208k - $315k/yr
Responsibilities
- Develop efficient agentic evaluation methods using adaptive sampling, early stopping, model cascades, caching, and cheap-first gating.
- Build AI model-routing systems with fallback, monitoring, and cost attribution.
- Fine-tune and serve open-weight models using LoRA and other parameter-efficient methods.
- Build predictive models for estimating task difficulty before frontier-system rollouts.
- Create golden datasets and measure the accuracy and calibration of LLM-as-judge systems.
- Turn research prototypes into reusable, configurable components for forward deployed engineers and researchers.
- Shape ML engineering standards, direction, and the team’s growth.
Requirements
- 5+ years building production ML or software systems with end-to-end ownership from prototype to production.
- Hands-on experience running LLM or ML workloads in production and reasoning about non-deterministic systems.
- Strong grounding in statistics and experimentation, including experiment design, hypothesis testing, sampling, and confidence intervals.
- Strong Python and software engineering fundamentals, including testing, code review, and system design.
- Experience designing evaluations and interpreting results rigorously.
- Ability to identify high-impact problems proactively and communicate clearly with researchers, engineers, and business partners.
- Preferred: experience fine-tuning and serving open-weight models, building LLM evaluation or experimentation platforms, model gateways or routing systems, and working with agentic workloads, benchmarks, or RL environments.
- Preferred: a record of taking research into production through publications, open-source work, or shipped research-driven features.
- Preferred: MS or PhD in Computer Science, Machine Learning, Statistics, or a related field.
Benefits
- Opportunity to work on frontier AI measurement and data-generation problems.
- Founding-team impact in defining ML engineering practices and growing the team.
- Meaningful opportunities for technical growth, leadership, learning, and influence over strategic priorities.
- Snorkel AI is an equal employment opportunity employer and provides reasonable accommodation for individuals with disabilities.
Tech Stack
Categories
About Snorkel AI
Snorkel AI builds tools and services for developing high-quality training, post-training, and evaluation data for LLMs and enterprise AI systems. It sells an enterprise platform plus expert-built datasets and benchmarks, and offers custom data development for AI labs, large enterprises, and federal customers. Founded in 2019 out of the Stanford AI Lab and headquartered in San Francisco, it is privately held.