about 3 hours ago
Remote, Canada
Senior
H1B Sponsor
Base Salary
$180k - $230k/yr
Responsibilities
- Design and build conversational AI agents for returns, claims, and customer service experiences.
- Own agent systems from architecture to implementation, evaluation, and production operations.
- Build retrieval pipelines that ground agent responses in real company and customer data.
- Design agent orchestration for multi-step workflows interacting with various systems.
- Create evaluation frameworks to measure task completion, accuracy, safety, and user satisfaction.
- Implement guardrails and safety mechanisms for content moderation and detection.
- Integrate conversational experiences across web, mobile, SMS, and email channels.
- Make decisions around prompt design, model selection, and tradeoffs.
- Collaborate with product, design, and ML teams to ensure technical soundness and product awareness.
Requirements
- Experience shipping conversational AI or agent-based systems in production.
- Built production systems using LLM APIs and agent frameworks with real integrations.
- Understanding of model selection tradeoffs and their implications.
- Advanced knowledge of prompt engineering techniques.
- Experience building context graph pipelines with entity resolution and relationship modeling.
- Designed agent architectures utilizing function calling and multi-step reasoning.
- Strong programming skills in Python or TypeScript.
- Experience building and integrating APIs and backend services.
- Comfortable reasoning about evaluation, safety, and reliability in non-deterministic systems.
- Proactive and able to operate with ambiguity.
Tech Stack
PythonTypeScript
Categories
AI & ML