5 months ago
Toronto, CanadaIntern
Responsibilities
- Execute structured test plans for AI Agent implementations.
- Validate that intents, entities, and workflows trigger correctly.
- Identify behavioral inconsistencies, misclassifications, or hallucinations.
- Review and validate AI-generated suggestions, summaries, and classifications.
- Provide actionable feedback to improve intent models and redaction/PII handling.
- Run bias, redaction, and transcription accuracy checks.
- Spot patterns or emerging issues across test sets.
- Contribute ideas for improving internal QA processes and tools.
Requirements
- Students interested in AI/ML, NLP, or chatbots.
- Interest in product quality and user experience.
- Background in linguistics, conversation analysis, or human–AI interaction.
- Desire to explore a career in AI evaluation, AI ops, or product QA.
- Strong analytical thinking and curiosity about intelligent systems.
Benefits
- $30-$50 per hour subject to taxes.
- Lunch can be expensed (up to $25) while working in the office.
- PT0: 4 days.
Categories
About Cresta
Cresta builds a generative AI platform for contact centers, combining AI agents, real-time agent assistance, conversation intelligence, and quality/coaching tools. It sells enterprise software to customer-support and sales organizations to automate and improve conversations across voice and digital channels. Founded in 2017 and headquartered in Sunnyvale, California, the privately held company counts brands such as Alaska Airlines, Cox Communications, Intuit, United Airlines, and Marriott among its customers.