1 month ago
Remote, CanadaSenior
Responsibilities
- Own AI workflows end to end, including scoping, design, implementation, launch, measurement, and iteration.
- Design agentic and LLM-based systems using extraction, retrieval, reasoning, tool use, and human-in-the-loop steps.
- Build production-grade LLM pipelines with prompt and context design, structured outputs, validation, fallbacks, and confidence scoring.
- Integrate AI services with backend systems using API contracts, retries, graceful degradation, and per-customer data isolation.
- Manage model selection, cost, and latency across workflow steps.
- Build evaluation sets and automated evaluations to detect regressions in prompts, models, and data.
- Instrument AI systems with logging, tracing, dashboards, alerts, and quality monitoring.
- Maintain audit trails for AI decisions in a regulated financial product.
- Establish shared AI engineering patterns and tooling, educate teammates on coding agents and AI tools, and review AI system designs.
Requirements
- 7+ years of professional software engineering experience, including at least 2 years building and operating LLM or AI-powered systems in production.
- Experience owning a large system or workflow end to end with limited direction.
- Hands-on experience shipping LLM-powered applications using APIs such as Anthropic or OpenAI, including structured outputs, error handling, and evaluation.
- Experience designing agentic or multi-step AI workflows involving tool use, orchestration, and human review steps.
- Strong proficiency in Python and solid backend fundamentals, including relational databases, asynchronous patterns, and a major cloud provider.
- Experience with observability for AI systems, including logging, tracing, dashboards, and quality monitoring.
- Professional fluency in written and spoken English.
Benefits
- Remote position based in the United States.
Categories
About Jeeves
Jeeves builds a finance platform for global businesses, combining multi-currency accounts, corporate cards, cross-border payments, and spend management in one system. The privately held company is headquartered in Miami and operates in 20+ countries across the Americas, the United Kingdom, and Europe, serving over 5,000 clients ranging from venture-backed startups to SMBs.