about 2 months ago
Base Salary
$190k - $260k/yr
Responsibilities
- Design and improve LLM-powered pipelines and agent architectures.
- Build robust evaluation and benchmarking frameworks to measure output quality and regression.
- Optimize for latency, cost, determinism, and output quality across high daily volume.
- Implement retrieval-augmented generation (RAG) and tool-use strategies where appropriate.
- Ship production-grade AI systems – not experiments.
- Collaborate closely with backend and product teams to integrate AI capabilities into the core platform.
Requirements
- 5+ years of professional software engineering experience.
- Hands-on experience building and shipping LLM-powered applications in production.
- Deep familiarity with LLM concepts: prompt engineering, structured extraction, function/tool calling, RAG, evaluation frameworks.
- Experience with AWS or comparable cloud infrastructure for AI workloads.
- Strong software engineering fundamentals – you write clean, maintainable systems, not just notebooks.
Benefits
- 401(k) Retirement Savings Plan.
- Equity Compensation.
- Dinner Provided via DoorDash & stocked kitchen for NY employees.
- Medical, Dental, and Vision coverage of up to 100% premiums for you and your family.
- HSA / FSA.
- 11 paid holidays each year.
- Unlimited PTO.
- Training and professional development.
- Hybrid Work Schedule (4 days onsite, 3 if located > 1 hour away).