Software Engineer
Neon Health1 year ago
Remote, United StatesMid Level / Senior
Base Salary
$140k - $200k/yr
Responsibilities
- Trace and fix runtime bugs and write regression tests.
- Design evaluation datasets that simulate realistic workflows and red-team the system.
- Build internal QA tooling, agent simulators, and evaluation infrastructure.
- Normalize and transform messy client data for system integration.
- Set up automated testing and latency-tracking infrastructure.
- Create dashboards and observability tooling for agentic system behavior.
- Expand the existing evaluation, testing, and agent simulation frameworks.
- Write and refine prompts and investigate real-world edge cases to improve agent performance.
Requirements
- Proficiency in TypeScript and Git.
- Strong generalist software engineering, debugging, system design, distributed systems, and reliability/performance tradeoff skills.
- Ability to trace runtime failures, inspect logs, and diagnose issues in asynchronous or multi-step agent systems.
- Experience building data transformation and ingestion pipelines for normalizing unstructured client data.
- Experience working closely with LLMs or AI agents in production systems, with 2–7 years of experience requested.
- Experience with testing, documentation, QA or evaluation tooling, agent simulation, system observability, or validating AI behavior through outputs is valuable.
- Familiarity with multi-agent systems, TTS/NLP pipelines, structured output validation, testing frameworks, LangChain-style orchestration, prompt engineering, LLM evaluations, or agent orchestration is a plus.
- Applicants must be authorized to work full-time in the United States; visa sponsorship is unavailable.
Benefits
- One week every month is spent at team offsites in locations such as Tahoe, Squamish, Mendocino, the Santa Cruz Mountains, and Monterey.
- Applicants must be authorized to work full-time in the United States; visa sponsorship is unavailable.
Tech Stack
Categories
About Neon Health
Neon Health builds an AI automation platform that streamlines patient access by automating benefit verification, prior authorization, financial assistance enrollment, patient onboarding, and adherence management. It sells to pharmaceutical manufacturers and other healthcare enterprises to reduce manual paperwork and speed therapy starts across specialty drugs and treatments. Founded in 2023 and headquartered in San Francisco, the privately held company focuses on phone-call automation and revenue-cycle adjacent workflows.