2 months ago
Base Salary
$182k - $220k/yr
Responsibilities
- Design, build, and ship production LLM-powered features end-to-end.
- Build prompt orchestration, tool calling, retrieval, embeddings, agent workflows, and structured-output systems.
- Develop regression suites, LLM-as-a-judge evaluations, synthetic datasets, human review workflows, and quality metrics.
- Design production observability for accuracy, latency, cost, hallucination rates, and model behavior.
- Build safety and reliability guardrails for quality, compliance, and operational requirements.
- Evaluate and integrate orchestration frameworks, evaluation platforms, vector databases, and model providers.
- Provide technical leadership through system design, code reviews, mentorship, and higher engineering standards.
- Work directly with clinical and operational teams to understand and automate workflows.
- Prototype quickly, ship early, measure outcomes, and iterate using real-world usage.
Requirements
- 5+ years of experience building production software, including at least 1–2 years building and deploying LLM-powered applications in production, or equivalent depth through substantial side projects or open-source work.
- Strong Python engineering skills and experience building backend services and integrating modern AI APIs and frameworks.
- Experience shipping AI features used by real users and measuring quality, reliability, latency, cost, and business impact.
- Strong product instincts and the ability to translate ambiguous operational problems into technical solutions.
- Experience using AI-assisted development tools throughout the software development lifecycle.
- Preferred experience with LangChain, LangGraph, AgentCore, RAG architectures, vector databases, prompt/version management, LangSmith, Braintrust, or Arize Phoenix.
Benefits
- Target base salary ranges from $182,300 to $220,000, plus competitive equity and benefits.
- Ro has been recognized as a top workplace in healthcare, New York, and for women and parents.
- Ro provides equal employment opportunities and reasonable accommodations for qualified applicants.
Tech Stack
Categories
