iHerb

Principal Engineer - AI Platform

iHerb
Apply
2 months ago
Remote, United StatesStaff+

Base Salary

$204k - $260k/yr

Responsibilities

  • Own the architecture and technical strategy for the AI Platform and GenAI product layer.
  • Lead development of shared retrieval infrastructure, RAG pipelines, model lifecycle capabilities, evaluation frameworks, guardrails, observability, and reusable platform services.
  • Build production AI systems, write proofs of concept, and validate architectural decisions through working software.
  • Define and enforce technical, architecture-review, and model-quality standards for the AI Platform team.
  • Coordinate boundaries between GenAI product capabilities and existing ML personalization infrastructure.
  • Establish and evolve AI-driven SDLC standards, Claude Code skills, guardrails, and automation patterns.
  • Lead complex multi-team technical initiatives and resolve competing architectural approaches.
  • Mentor senior engineers and raise engineering quality through code reviews, architecture reviews, and coaching.
  • Represent engineering in cross-functional discussions and document architectural decisions in the shared knowledge base.

Requirements

  • 10+ years of software engineering experience, with a significant portion at senior, staff, or principal individual-contributor level.
  • Demonstrated use of AI-assisted development tools such as Claude Code, GitHub Copilot, or Cursor to ship production systems.
  • Experience designing and evolving large-scale distributed systems across multiple teams, including APIs, data pipelines, event-driven architectures, or high-traffic platforms.
  • Track record of driving architectural standards, technical roadmaps, or platform initiatives across multiple teams or organizations.
  • Production experience designing and operating AI platform systems, including RAG pipelines, vector search, embedding infrastructure, or retrieval-augmented applications at scale.
  • Hands-on experience building LLM evaluation frameworks, defining quality metrics, and improving model and prompt quality using data.
  • Production MLOps experience covering model deployment, monitoring, lifecycle management, and cost governance.
  • Experience building and operating agentic systems with frameworks such as LangChain, LlamaIndex, or equivalent.
  • Required production GenAI experience; prototype-only or research-only experience is insufficient.
  • Experience working in distributed teams across the United States, China, and Latin America.
  • Strong communication, architecture documentation, consensus-building, judgment, organization, and attention-to-detail skills.
  • Experience with Microsoft Office Suite; Google Business Suite experience is preferred.
  • Bachelor’s degree in Computer Science or a related field is preferred, or equivalent education and work experience.

Benefits

  • Expected base salary range is $204,000.00–$260,000.00 USD.
  • Office/warehouse work environment with a professional, fast-paced setting and possible extended hours as required.
  • Reasonable accommodations may be made for individuals with disabilities.
iHerb

About iHerb

1,001-5,000 employees
Contact me