2 days ago
Toronto, CanadaStaff+
Responsibilities
- Create and maintain test cases for prompt-driven applications, AI agents, RAG systems, and workflow orchestration platforms.
- Design, build, and maintain automated test frameworks and scalable UI, API, mobile, and database automation architectures.
- Develop automated evaluation pipelines for AI responses, workflows, and model behavior.
- Lead automation-first quality strategies and solutions across programs.
- Test AI agents, copilots, APIs, workflow engines, MCP integrations, and tool-calling capabilities.
- Develop GenAI-powered solutions for automated test design, code generation, execution, and defect analysis.
- Integrate AI and regression test suites into CI/CD pipelines and enforce quality gates.
- Collaborate with cross-functional teams and mentor engineers on GenAI, agentic AI, automation, model deployment, and AI safety practices.
Requirements
- 10+ years of Quality Engineering experience covering functional, API, integration, and automation testing, with a dedicated focus on AI testing and validation.
- 3+ years of experience testing AI/ML systems.
- Expert proficiency in AI/ML testing frameworks, MLOps, CI/CD integration, Python, and Java.
- Hands-on experience with GitHub Copilot, Claude, AI platforms, and prompt engineering.
- Ability to work independently, lead a team, and engage with senior business and technology stakeholders.
- Exposure to the life insurance or retirement domain is preferred.
Benefits
- Hybrid work arrangement requiring three days per week in a client or Cognizant office in Toronto or Kitchener.
- Wellbeing programs supporting physical, mental, and financial health.
- Eligibility for Cognizant’s discretionary annual performance-based bonus.
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.