Staff AI Engineer
Hippocratic AIResponsibilities
- Architect and own production-grade AI pipelines for voice-based healthcare agents, including retrieval, multi-step reasoning, agent orchestration, and evaluation systems.
- Lead cross-functional initiatives with product, clinical, and engineering teams to create safe, scalable, and human-centered AI experiences.
- Represent engineering in high-stakes clinical and partner conversations.
- Drive zero-to-one initiatives using LLMs, retrieval systems, and streaming architectures while balancing innovation and reliability.
- Define standards, safety testing, evaluation gates, and observability for real-time and long-running conversational agents.
- Mentor senior and mid-level engineers and improve engineering quality through code and design reviews.
Requirements
- At least 6 years of professional experience in software, ML, or AI engineering.
- Proven experience building and shipping AI- or ML-powered products in production.
- Strong Python programming skills and experience with distributed systems, APIs, and data pipelines.
- Deep understanding of prompt engineering, vector databases, and retrieval systems such as RAG; voice-agent experience is helpful or must be learned rapidly.
- Experience with AWS, GCP, or Azure and modern DevOps practices including Terraform, CI/CD, and monitoring.
- Excellent communication, cross-functional collaboration, and ability to work in high-impact domains.
- Preferred experience deploying LLM-based or multi-agent systems at scale.
- Preferred hands-on experience with speech recognition, text-to-speech, or streaming architectures for real-time AI experiences.
- Prior healthcare, safety-critical, or regulated product development experience is preferred.
Benefits
- Expected to work from the Palo Alto office five days per week.
Categories
About Hippocratic AI
Hippocratic AI has developed a safety-focused Large Language Model (LLM) for healthcare. The company believes that a safe LLM can dramatically improve healthcare accessibility and health outcomes in the world by bringing deep healthcare expertise to every human. No other technology has the potential to have this level of global impact on health. The company was co-founded by CEO Munjal Shah, alongside a group of physicians, hospital administrators, healthcare professionals, and artificial intelligence researchers from El Camino Health, Johns Hopkins, Stanford, Microsoft, Google, and NVIDIA. Hippocratic AI has received a total of $278 million in funding and is backed by leading investors, including Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems. For more information on Hippocratic AI, www.HippocraticAI.com. Be aware of recruitment scams impersonating Hippocratic AI. All recruiting communication will come from @hippocraticai.com email addresses. We will never request payment or sensitive personal information. If anything appears suspicious, stop engaging immediately and report the incident.