4 hours ago
Remote, WorldwideSenior
Base Salary
$150k - $200k/yr
Responsibilities
- Own the full lifecycle of clinical extraction models from problem framing, data and annotation strategy, and model selection through training, evaluation, deployment, monitoring, and retraining.
- Define accuracy standards with clinical and customer-facing stakeholders and build a defensible evaluation harness.
- Partner with Clinical Data Managers on curation, model specifications, QA/QC tooling, sampling, error analysis, and human-in-the-loop review.
- Build clinical NLP pipelines for messy real-world data and work with backend engineers to productionize them.
- Develop and rigorously evaluate LLM-based approaches, including versioned prompts, structured output, retrieval, cost and latency tracking, and observability.
- Address de-identification, PHI handling, audit trails, and access controls as part of the modeling work.
- Shape the technical roadmap and help establish the ML capability as the company’s first ML hire.
Requirements
- Healthcare or life sciences experience working with real clinical data such as clinical notes, EHR data, claims, or registries.
- At least 6 years of applied machine learning experience, including personally taking models from problem definition through production and ongoing maintenance.
- Deep applied ML experience with text, including information extraction, named entity recognition, classification, sequence labeling, weak supervision, annotation guidelines, and inter-annotator agreement.
- Practical experience with LLM approaches including prompt development, structured output, retrieval, fine-tuning, evaluation, and observability.
- Strong Python engineering skills and experience running production systems rather than only notebook-based work.
- Strong cross-functional communication, problem definition, documentation, and self-directed problem-solving skills.
- Experience with clinical terminologies and standards such as SNOMED CT, ICD-10, LOINC, RxNorm, CPT, and FHIR is preferred.
- Experience with HIPAA, SOC 2, de-identification methodology, IRB or regulatory-grade data work, early-stage or first-ML-hire environments, human-in-the-loop annotation and QC, OCR, document understanding, or mentoring and leading ML engineers is preferred.
Benefits
- Equity in Novellia.
- Medical, dental, and vision coverage.
- 401(k).
- Flexible time off.
- Wellness stipend.
- Up to 12 weeks of parental leave.
- U.S. applicants only; the posting does not state a remote, hybrid, or in-office arrangement.
Tech Stack
Categories
About Novellia
Novellia is the first and only company that lets anyone in the US gain access to nearly a decade of their health data in under 30 seconds, 100% free. All your health records, across doctors, all in one place, always up to date. We work with the world's top researchers to safely turn health insights into life-changing action for millions of people across the world.