Sr. Staff Machine Learning Systems Engineer
Hims & HersBase Salary
$240k - $265k/yr
Responsibilities
- Set technical direction for evaluation systems, including metric, judge, scorer, statistical regression, and failure-tracking design
- Design and scale ingestion, transformation, dataset-versioning, labeling, and calibration pipelines for evaluation and data science
- Define evaluation approaches for new AI services and lead multi-team initiatives to replace manual reviews with automated statistical gates
- Own adversarial and red-team evaluation programs, including test suites and failure taxonomies for safety and edge-case risks
- Lead ambiguous, cross-team projects from initial concept through production and drive alignment across engineering, product, AI, clinical, legal, and platform stakeholders
- Originate reusable evaluation methodologies and lead major platform improvements with organization-wide impact
- Share evaluation and data pipeline expertise through internal talks and written guidance
- Mentor engineers, including experienced engineers, and raise technical and statistical standards
Requirements
- 10+ years of experience in ML infrastructure, data engineering, or evaluation/testing systems
- Hands-on experience designing and calibrating LLM judges and scorers, statistically sound regression testing, human-label agreement measurement, and adversarial or red-team evaluations
- Hands-on experience with dataset versioning, feature and benchmark pipelines, labeling and calibration workflows, and high-throughput ingestion and transformation systems
- Demonstrated impact beyond a single team or project and a history of establishing standard approaches for broader groups
- Experience leading multi-team projects to completion and resolving significant technical disagreements
- Experience mentoring engineers, including senior engineers, and raising the technical and statistical bar of teams
- Excellent communication and ability to build support across varied audiences before launch
- Strong Python skills and sufficient statistical fluency to design and defend production testing frameworks
- Preferred: experience with Databricks, MLflow, Unity Catalog, or similar data and evaluation platforms
- Preferred: experience building reporting tools such as automated Slack digests or spreadsheet reports for non-technical teams
- Preferred: experience in a regulated industry such as healthcare, fintech, or life sciences
- Preferred: company-wide talks or write-ups that changed how other teams approached a problem
Benefits
- Competitive salary and equity compensation for full-time roles
- Unlimited paid time off, company holidays, and quarterly mental health days
- Medical, dental, vision, and parental leave benefits
- Employee Stock Purchase Program (ESPP)
- 401(k) with employer matching contribution
- Offsite team retreats
- Flexible and remote work approach
Tech Stack
Categories
About Hims & Hers
Hims & Hers Health, Inc. (better known as Hims & Hers) is a multi-specialty telehealth platform building a virtual front door to the healthcare system. We connect consumers to licensed healthcare professionals, enabling people to access high-quality medical care—from wherever is most convenient—for numerous conditions related to sexual health, hair care, mental health, skincare, primary care, and more. With products and services available across all 50 states and Washington, D.C., Hims & Hers is on a mission to help the world feel great through the power of better health. We believe how you feel in your body and mind transforms how you show up in life. That’s why we’re building a future where nothing stands in the way of harnessing this power. We normalize health & wellness challenges—and innovate on their solutions—to make feeling happy and healthy easy to achieve. No two people are the same, so we provide access to personalized care designed for results. At our core, our mission is deeply personal—because we too are customers. In January 2021, the company was listed on the NYSE and is traded under the ticker symbol “HIMS”. To learn more about our brand and offerings, you can visit hims.com and forhers.com.