Physician AI Engineer
Counsel Health2 months ago
Remote, United StatesSenior
Responsibilities
- Own the end-to-end development of clinical and safety agents, including scoping, PRD writing, architecture, evaluation design, implementation, review, and production launch.
- Build and productionize a clinical evaluation framework that serves as the quality and safety bar for at least one agent.
- Improve Counsel AI capabilities including history-taking, differential diagnosis, triage, and treatment planning using representative physician case sets.
- Analyze the existing codebase, evaluation processes, clinical workflows, and safety systems to identify and prioritize weaknesses.
- Prototype, test, iterate, and ship an agent or safety component from workflow observation through production deployment.
Requirements
- MD, DO, or international equivalent, with completed residency training or at least 3 years of clinical experience.
- Substantive hands-on experience building LLM-powered systems in production, beyond experimentation.
- Demonstrated ownership of shipped products in an industry or startup environment; health technology experience is strongly preferred.
- Board-eligible or board-certified status with meaningful active or recent clinical practice is strongly preferred.
- Published research, open-source work, or public writing related to clinical AI or LLM evaluations is strongly preferred.
- Experience working within an engineering organization is strongly preferred.
- Ability to combine clinical reasoning, software development, product judgment, experimentation, and patient-safety analysis.
Categories
About Counsel Health
Counsel Health builds an AI-enabled, physician-supervised primary care service delivered through secure messaging. It sells to health plans, consumer health solutions, employers, and health systems as a replacement for nurse advice lines and legacy telehealth, aiming to improve access while controlling costs. Founded in 2023 and headquartered in Boston, MA, the privately held company operates a vertically integrated medical group supported by custom clinical AI tools.