iHerb

Sr. Software Engineer II - AI

iHerb
Apply
2 months ago
Remote, United StatesSenior

Base Salary

$187k - $235k/yr

Responsibilities

  • Design, build, deploy, and operate production AI features such as RAG pipelines, LLM recommendations, conversational agents, and agentic workflow automation.
  • Build shared AI platform infrastructure for retrieval, evaluations, model monitoring, guardrails, and observability.
  • Develop LLM applications and integrations for marketing platforms, BI tools, and customer-facing products.
  • Evaluate and improve model and feature quality through structured evaluations, prompt iteration, retrieval strategies, and model selection.
  • Use AI-assisted SDLC tools daily while delivering AI and non-AI production software.
  • Coordinate GenAI features with existing ML personalization signals.
  • Document architecture decisions, evaluation results, and operational lessons.
  • Own AI-system observability for latency, cost, quality drift, and error rates; participate in on-call and production incident response.

Requirements

  • At least 10 years of software engineering experience.
  • Bachelor’s degree in Computer Science or a related field preferred, or equivalent education and work experience.
  • Hands-on experience shipping production code with AI-assisted tools such as Claude Code, GitHub Copilot, or Cursor.
  • Python proficiency and experience building and operating production LLM applications.
  • Experience with at least one of RAG and retrieval systems, LLM evaluation, agentic frameworks, or LLM-based workflow automation.
  • Understanding of prompt engineering, context-window management, and LLM output-quality tradeoffs.
  • Familiarity with vector databases, embedding models, or semantic search.
  • Ability to contribute across the full stack, own features through deployment and on-call, make technical decisions autonomously, and mentor junior engineers.
  • Strong software design, automated testing, code review, and CI/CD fundamentals.
  • Preferred: exposure to MLOps or model deployment pipelines, developer tooling or SDLC improvements, e-commerce or high-traffic consumer applications, distributed teams, and architectural documentation or RFCs.
  • Experience with Microsoft Office Suite; Google Business Suite experience is preferred.

Benefits

  • Office/warehouse work environment with a professional, casual, hectic, fast-paced setting and possible extended hours.
  • The role includes participation in an on-call rotation and production incident response.
  • Expected base salary range is $187,000.00–$235,000.00 USD.

Tech Stack

Categories

iHerb

About iHerb

1,001-5,000 employees
Contact me