27 days ago
Toronto, CanadaMid Level / Senior
Responsibilities
- Define and track success metrics with customers and customer success teams.
- Monitor performance of deployed AI agents and identify performance gaps.
- Tune prompts, workflows, and agent behavior to enhance outcomes.
- Iterate on agent logic, tool usage, and context management.
- Debug issues across prompts, integrations, and system behavior.
- Translate real-world usage into product and system improvements.
Requirements
- Strong technical background with coding ability when needed.
- Deep experience with prompt engineering and LLM behavior.
- Strong understanding of agent systems including tool calling and context management.
- Heavy user of AI tools like Cursor, Claude, and Codex.
- Ability to debug ambiguous issues across AI and system layers.
- Strong ownership and communication skills, comfortable under pressure.
- Experience implementing agentic workflows or AI agents in enterprise environments.
- Programming fundamentals with Python/JS experience are a plus.
Benefits
- Direct ownership over AI performance in real-world applications.
- Opportunity to work on high-impact problems tied to customer outcomes.
- High visibility across product, engineering, and customer teams.
- Fast-paced, execution-driven work environment.