11 hours ago
Noida, India +12 moreStaff+
Responsibilities
- Lead functional test planning and execution for Copilot Studio agents.
- Design test plans and cases covering topics, trigger phrases, entities, variables, conversation flows, and agent behavior.
- Validate generative orchestration, generative answers, grounding, accuracy, and response consistency.
- Test Power Automate flows and MCP Server tool or plugin integrations, including error and failure scenarios.
- Perform responsible AI validation for bias, safety, and hallucinations.
- Test agent publishing across Teams, web, custom applications, and development, test, and production environments.
- Identify, triage, track, and verify fixes for conversational breakdowns, connector issues, and plugin defects.
- Execute functional and regression testing, maintain test evidence, and support UAT coordination and release readiness.
- Ensure solutions meet the agreed Definition of Done before UAT and collaborate with developers, architects, and business analysts.
Requirements
- At least 5 years of experience in functional or QA testing is required.
- 15 years of full-time education is required.
- Experience testing conversational AI, chatbots, or low-code platforms is preferred.
- Hands-on experience testing Copilot Studio agents, including topics, generative answers, knowledge sources, and publishing, is required.
- Working knowledge of Power Automate flows and API or tool integration testing concepts, including MCP Server connections, is required.
- Understanding of responsible AI principles and bias or safety validation practices is required.
- Experience with defect management and test tracking tools such as Azure DevOps or Jira is required.
- Strong attention to detail and a structured approach to test design and conversational-flow troubleshooting are required.
- Exposure to Agile delivery environments is preferred.
Categories
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.