2 days ago
London, United KingdomMid Level

Responsibilities

  • Build end-to-end AI-enabled product features spanning user interfaces, backend services, AI orchestration, retrieval, and enterprise integrations.
  • Design agentic workflows with structured outputs, tool calling, workflow orchestration, document processing, human review, and appropriate controls.
  • Develop reusable agent harnesses for tools, state, context, approvals, traces, and test fixtures.
  • Build grounded retrieval and context systems using approved data sources, search indexes, document repositories, permissions, evidence, and citations.
  • Design and operate evaluation harnesses with curated test sets, representative scenarios, automated and human grading, regression tests, trace review, and user feedback.
  • Manage prompts, model configuration, tool schemas, routing, fallbacks, and cost and latency trade-offs as tested product assets.
  • Implement AI observability using traces, logs, metrics, and evaluation results.
  • Build APIs, integrate approved business and data systems, and create interfaces for inspecting AI output, evidence, feedback, review, and approvals.
  • Write maintainable Python and TypeScript code and use Docker, Git, automated testing, and CI/CD for repeatable development and deployment.
  • Apply security, authentication, authorization, sensitive-data handling, deployment, and release patterns in collaboration with firm technology teams.

Requirements

  • At least three years of professional experience delivering production AI products, with recent experience building AI-enabled products or workflows in a SaaS environment.
  • Strong Python skills and practical TypeScript or JavaScript experience.
  • Experience building APIs and services with FastAPI, Flask, or comparable technologies, and interfaces with React, Next.js, or equivalent.
  • Experience with LLM APIs, structured outputs, retrieval, embeddings, tool calling, agents, or workflow orchestration.
  • Experience building agentic systems with agent frameworks or custom orchestration patterns, including tools, state or context management, and human-review or approval controls.
  • Experience evaluating AI workflows through test sets, scenario design, model or prompt experiments, trace review, user feedback, and automated or human grading.
  • Experience taking AI features from prototype to controlled production, including testing, monitoring, troubleshooting, and ongoing improvement.
  • Experience with AI observability, tracing, and evaluation tooling, plus strong understanding of grounded retrieval, context quality, evidence, citations, and AI failure modes.
  • Experience designing APIs and integrating enterprise systems, with sound handling of authentication, authorization, secrets, and sensitive data.
  • Comfort with Docker, Git, automated testing, and CI/CD; dedicated platform engineering experience is not required.
  • Strong debugging and systems-thinking skills and the ability to explain AI behavior, evaluation results, and technical trade-offs to technical and non-technical colleagues.
  • Legal technology or law firm experience is advantageous but not required.

Benefits

  • Flexible work model allowing work from the office and a remote location.
  • Family-friendly and inclusive employment policies, plus programs and services supporting health and wellbeing.
  • Equal-opportunity employer with an accessible recruitment process and tailored adjustments or accommodations available.
National Retail Federation

About National Retail Federation

501-1,000 employees

The National Retail Federation is a nonprofit trade association for retailers and retail technology vendors, funded by membership dues, sponsorships, and events. It advocates on policy, publishes research and education, and runs industry conferences such as NRF’s annual Big Show. Founded in 1911 and headquartered in Washington, DC, it represents retailers of all sizes across the U.S. and abroad.

Contact me