about 7 hours ago
Base Salary
$230k - $300k/yr
Responsibilities
- Design and improve LLM-powered pipelines and agent architectures.
- Build robust evaluation and benchmarking frameworks to measure output quality and regressions.
- Optimize AI systems for latency, cost, determinism, and output quality at high daily volume.
- Implement retrieval-augmented generation and tool-use strategies where appropriate.
- Ship production-grade AI systems rather than experiments.
- Collaborate with backend and product teams to integrate AI capabilities into the core platform.
- Transform raw session data into clinically structured outputs.
Requirements
- At least 5 years of professional software engineering experience.
- Hands-on experience building and shipping LLM-powered applications in production at meaningful scale.
- Deep familiarity with prompt engineering, structured extraction, function/tool calling, retrieval-augmented generation, and evaluation frameworks.
- Experience with AWS or comparable cloud infrastructure for AI workloads.
- Strong software engineering fundamentals and the ability to write clean, maintainable production systems.
- Understanding of modern agent patterns including tool calling, RAG, memory, and orchestration.
- Experience with evaluation, hallucination mitigation, reliability, performance, and operational excellence.
Benefits
- 401(k) retirement savings plan
- Equity compensation
- Dinner provided via DoorDash and stocked kitchen for New York employees
- Medical, dental, and vision coverage of up to 100% of premiums for the employee and family
- HSA/FSA
- 11 paid holidays each year
- Unlimited PTO
- Training and professional development
- Hybrid work schedule: 4 days onsite, or 3 days onsite if located more than 1 hour away
About Brellium
Brellium’s clinical AI audits 100% of your documentation and coding — catching compliance risks before they become clawbacks and surfacing revenue you’ve earned but haven’t billed. Trusted by 250,000+ providers.