Senior Machine Learning Engineer
Hippocratic AIResponsibilities
- Design and build evaluation frameworks for LLM safety, clinical accuracy, and conversational quality.
- Develop synthetic data generation pipelines to stress-test models across diverse clinical scenarios.
- Build automated and human-in-the-loop evaluation pipelines at scale.
- Create benchmarks, metrics, and LLM-as-judge systems for healthcare tasks and conversational experiences.
- Analyze failure modes and translate findings into actionable model improvements with the LLM post-training team.
- Collaborate with research, engineering, and clinical teams to define and raise quality standards.
Requirements
- MS or PhD in computer science or a related field.
- At least five years of experience in ML engineering, evaluation systems, or applied ML.
- Strong software engineering skills with Python, PyTorch, and production-quality code.
- Hands-on experience with LLM evaluation, benchmarking, or synthetic data generation.
- Experience building robust data analysis and evaluation infrastructure rather than only running experiments.
- Experience with UI/UX and front-end development toolkits such as Streamlit, Gradio, or React.
- Healthcare AI experience is preferred.
- Experience with RL, RLVR, RLHF, or safety evaluation is preferred.
Benefits
- Expected to work in the Palo Alto office five days a week unless otherwise specified.
- Opportunity to work on safety-focused healthcare AI and systems that directly influence production readiness.
Categories
About Hippocratic AI
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health. The company was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA. Hippocratic AI has received a total of $278 million in funding and is backed by leading investors, including Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems. For more information on Hippocratic AI, www.HippocraticAI.com. Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information. If anything appears suspicious, stop engaging immediately and report the incident.