Senior Applied Scientist
Hippocratic AI1 month ago
Responsibilities
- Build and maintain reliable, reproducible training, evaluation, and deployment loops for the self-improvement system.
- Design and implement reward and feedback signals while investigating reward hacking, specification gaming, and distribution drift.
- Build evaluation harnesses and metrics to measure model improvement and system safety.
- Own data pipelines and automated data flywheels that feed the learning loop.
- Debug model-quality regressions and stabilize non-stationary training and feedback loops.
- Collaborate with research and product teams to turn methods into robust, shippable systems.
Requirements
- Excellent Python skills and the ability to write clean, well-tested ML training code.
- Strong machine learning engineering fundamentals, including data pipelines, distributed or large-scale training, and experiment tracking.
- Hands-on experience building or owning a feedback loop, reward model, evaluation harness, RLHF/RLAIF or active-learning system, retraining pipeline, continual-learning pipeline, or agentic evaluation harness.
- Working knowledge of reward modeling, on-policy and off-policy tradeoffs, credit assignment, and feedback-system failure modes.
- Experience shipping an ML system to production and maintaining its reliability over time.
- Ability to debug silent model-quality degradation and evaluate systems whose behavior and data distribution change over time.
- Preferred experience with RLHF, agents, large-scale ML infrastructure, LLM fine-tuning, evaluation frameworks, or agent orchestration.
- PhD or MS in reinforcement learning or machine learning paired with real production experience is preferred.
Benefits
- Opportunity to work on a safety-focused healthcare AI platform intended to improve patient outcomes.
- Collaboration with experts from healthcare, AI research, and technology organizations.
- The company is an equal opportunity employer and provides accommodations during the hiring process.
Tech Stack
Categories
About Hippocratic AI
Hippocratic AI builds a safety-focused large language model and AI agents for healthcare workflows, used by health systems for patient outreach, post-discharge follow-up, and chronic-care management. It licenses its platform and tools to providers to automate and scale clinical support tasks while meeting health-system requirements. Founded in 2023 and headquartered in Palo Alto, the company is privately held.