Responsibilities
- Design and implement test strategies aligned with risk, compliance, and regulatory requirements.
- Define test scope, acceptance criteria, quality gates, and mitigation plans for AI and risk reporting solutions.
- Collaborate with Risk and Compliance stakeholders to translate requirements into testable specifications.
- Design and code test utilities, quality assurance tools, and production server applications.
- Perform functional, integration, system-level, performance, reliability, and regression testing.
- Design and execute tests for AI code agents, autonomous systems, and LLM-powered applications, including edge-case and failure-scenario analysis.
- Evaluate AI-agent accuracy, false positives, code quality, prompt outputs, and hallucination behavior.
- Validate database schemas, data models, data integrity, and reporting consistency using SQL queries.
- Build and maintain scalable automated test frameworks and test suites using Python.
- Execute automated tests through CI/CD pipelines and support data governance and quality initiatives where applicable.
Requirements
- 5+ years of hands-on Python development experience with advanced knowledge of object-oriented programming, design patterns, asynchronous programming, and data structures.
- Strong software development experience designing, coding, debugging, and testing applications.
- Hands-on experience testing AI models and machine learning systems.
- Experience testing AI code agents, autonomous systems, or LLM-powered applications, including prompt engineering, output validation, and hallucination detection.
- Experience testing Model Context Protocol implementations and integrations.
- Knowledge of relational and non-relational databases, including Oracle, SQL Server, PostgreSQL, and MongoDB.
- Understanding of DevOps practices and containerization.
- Proficiency with Git and GitHub Actions for CI/CD automation and workflow orchestration.
- Preferred qualifications include software development certifications or advanced programming credentials, data governance and quality framework experience, metadata management, AI-agent frameworks, orchestration tools, and Infrastructure as Code knowledge.
Benefits
- Comprehensive Total Rewards Program including bonuses and flexible benefits, with competitive compensation, commissions, and stock where applicable.
- Coaching and management opportunities to support professional development.
- World-class financial-services training and opportunities for progressively greater accountability.
- Dynamic, collaborative, progressive, and high-performing team environment.
- Regular full-time position based in Toronto at RBC WaterPark Place, with 37.5 work hours per week.
- Access to varied job opportunities across business areas and geographies.
Tech Stack
Categories
About RBC
Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance. Our success comes from the 94,000+ employees who leverage their imaginations and insights to bring our vision, values and strategy to life so we can help our clients thrive and communities prosper. As Canada's biggest bank and one of the largest in the world, based on market capitalization, we have a diversified business model with a focus on innovation and providing exceptional experiences to our more than 17 million clients in Canada, the U.S. and 27 other countries. Learn more at rbc.com. We are proud to support a broad range of community initiatives through donations, community investments and employee volunteer activities. See how at www.rbc.com/community-social-impact. http://rbc.com/legalstuff. La Banque Royale du Canada est une institution financière mondiale définie par sa raison d'être, guidée par des principes et orientée vers l'excellence en matière de rendement. Notre succès est attribuable aux quelque 94 000+ employés qui mettent à profit leur créativité et leur savoir faire pour concrétiser notre vision, nos valeurs et notre stratégie afin que nous puissions contribuer à la prospérité de nos clients et au dynamisme des collectivités. Selon la capitalisation boursière, nous sommes la plus importante banque du Canada et l'une des plus grandes banques du monde. Nous avons adopté un modèle d'affaires diversifié axé sur l'innovation et l'offre d'expériences exceptionnelles à nos plus de 17 millions de clients au Canada, aux États Unis et dans 27 autres pays. Pour en savoir plus, visitez le site rbc.com/francais Nous sommes fiers d'appuyer une grande diversité d'initiatives communautaires par des dons, des investissements dans la collectivité et le travail bénévole de nos employés. Pour de plus amples renseignements, visitez le site www.rbc.com/collectivite-impact-social. https://www.rbc.com/conditions-dutilisation/