2 months ago
Remote, United StatesSenior
Base Salary
$150k - $200k/yr
Responsibilities
- Own the full lifecycle of clinical extraction models from problem framing, data and annotation strategy, and model selection through training, evaluation, deployment, monitoring, and retraining.
- Define accuracy standards with clinical and customer-facing stakeholders and build a defensible evaluation harness.
- Partner with Clinical Data Managers on curation, model specifications, QA/QC tooling, sampling, error analysis, and human-in-the-loop review.
- Build clinical NLP pipelines for messy real-world data and work with backend engineers to productionize them.
- Develop and rigorously evaluate LLM-based approaches, including versioned prompts, structured output, retrieval, cost and latency tracking, and observability.
- Address de-identification, PHI handling, audit trails, and access controls as part of the modeling work.
- Shape the technical roadmap and help establish the ML capability as the company’s first ML hire.
Requirements
- Healthcare or life sciences experience working with real clinical data such as clinical notes, EHR data, claims, or registries.
- At least 6 years of applied machine learning experience, including personally taking models from problem definition through production and ongoing maintenance.
- Deep applied ML experience with text, including information extraction, named entity recognition, classification, sequence labeling, weak supervision, annotation guidelines, and inter-annotator agreement.
- Practical experience with LLM approaches including prompt development, structured output, retrieval, fine-tuning, evaluation, and observability.
- Strong Python engineering skills and experience running production systems rather than only notebook-based work.
- Strong cross-functional communication, problem definition, documentation, and self-directed problem-solving skills.
- Experience with clinical terminologies and standards such as SNOMED CT, ICD-10, LOINC, RxNorm, CPT, and FHIR is preferred.
- Experience with HIPAA, SOC 2, de-identification methodology, IRB or regulatory-grade data work, early-stage or first-ML-hire environments, human-in-the-loop annotation and QC, OCR, document understanding, or mentoring and leading ML engineers is preferred.
Benefits
- Equity in Novellia.
- Medical, dental, and vision coverage.
- 401(k).
- Flexible time off.
- Wellness stipend.
- Up to 12 weeks of parental leave.
- U.S. applicants only; the posting does not state a remote, hybrid, or in-office arrangement.
Tech Stack
Categories
About Novellia
Novellia builds a consumer health-data platform that lets people in the United States retrieve and unify their medical records across providers in under 30 seconds, free of charge. The service aggregates and keeps nearly a decade of personal health records up to date in one place, and supports research collaborations using health insights. It is privately held, founded in 2023, and headquartered in New York City.