Sr. Staff Machine Learning Systems Engineer
Hims & Hers2 months ago
Base Salary
$240k - $265k/yr
Responsibilities
- Set technical direction for evaluation systems, including metric, judge, scorer, statistical regression, and failure-tracking design
- Design and scale ingestion, transformation, dataset-versioning, labeling, and calibration pipelines for evaluation and data science
- Define evaluation approaches for new AI services and lead multi-team initiatives to replace manual reviews with automated statistical gates
- Own adversarial and red-team evaluation programs, including test suites and failure taxonomies for safety and edge-case risks
- Lead ambiguous, cross-team projects from initial concept through production and drive alignment across engineering, product, AI, clinical, legal, and platform stakeholders
- Originate reusable evaluation methodologies and lead major platform improvements with organization-wide impact
- Share evaluation and data pipeline expertise through internal talks and written guidance
- Mentor engineers, including experienced engineers, and raise technical and statistical standards
Requirements
- 10+ years of experience in ML infrastructure, data engineering, or evaluation/testing systems
- Hands-on experience designing and calibrating LLM judges and scorers, statistically sound regression testing, human-label agreement measurement, and adversarial or red-team evaluations
- Hands-on experience with dataset versioning, feature and benchmark pipelines, labeling and calibration workflows, and high-throughput ingestion and transformation systems
- Demonstrated impact beyond a single team or project and a history of establishing standard approaches for broader groups
- Experience leading multi-team projects to completion and resolving significant technical disagreements
- Experience mentoring engineers, including senior engineers, and raising the technical and statistical bar of teams
- Excellent communication and ability to build support across varied audiences before launch
- Strong Python skills and sufficient statistical fluency to design and defend production testing frameworks
- Preferred: experience with Databricks, MLflow, Unity Catalog, or similar data and evaluation platforms
- Preferred: experience building reporting tools such as automated Slack digests or spreadsheet reports for non-technical teams
- Preferred: experience in a regulated industry such as healthcare, fintech, or life sciences
- Preferred: company-wide talks or write-ups that changed how other teams approached a problem
Benefits
- Competitive salary and equity compensation for full-time roles
- Unlimited paid time off, company holidays, and quarterly mental health days
- Medical, dental, vision, and parental leave benefits
- Employee Stock Purchase Program (ESPP)
- 401(k) with employer matching contribution
- Offsite team retreats
- Flexible and remote work approach
Tech Stack
Categories
About Hims & Hers
Hims & Hers operates a direct-to-consumer telehealth and pharmacy platform for men’s and women’s health, offering online visits, prescriptions, and over‑the‑counter products for conditions like hair loss, sexual health, dermatology, and mental health. It monetizes through subscriptions and product sales, with nationwide shipping and affiliated providers and pharmacies. Founded in 2017 and headquartered in San Francisco, the company went public on the NYSE under the ticker HIMS in 2021.