13 hours ago
Kolkāta, India +6 moreStaff+
Responsibilities
- Lead a team of quality engineers through planning, ecosystem integration, and quality activities across the application lifecycle.
- Design and execute functional and regression test plans and test cases for Copilot Studio agents, including topics, trigger phrases, entities, variables, and conversation flows.
- Validate generative orchestration and generative answers for accuracy, grounding, and response consistency.
- Test Power Automate flows and MCP Server tool or plugin integrations for correctness, error handling, and failure scenarios.
- Perform responsible AI validation, including bias, safety, and hallucination checks.
- Test agent publishing across Teams, web, and custom applications and across development, test, and production environments.
- Identify, log, triage, track, and verify fixes for conversational breakdowns, connector issues, and plugin defects.
- Maintain test evidence, confirm Definition of Done criteria, collaborate on requirements and edge cases, and support UAT and release readiness.
- Define and implement testing metrics and manage test execution and defect resolution.
Requirements
- At least 5 years of experience is required.
- 15 years of full-time education is required.
- Experience in functional or QA testing, preferably involving conversational AI, chatbots, or low-code platforms.
- Hands-on experience testing Copilot Studio agents, including topics, generative answers, knowledge sources, and publishing.
- Working knowledge of Power Automate flows and API or tool integration testing concepts, including MCP Server connections.
- Understanding of responsible AI principles and bias and safety validation practices.
- Experience with defect management and test tracking tools such as Azure DevOps or Jira.
- Strong attention to detail and a structured approach to test design and conversational-flow troubleshooting.
- Exposure to Agile delivery environments is preferred.
Categories
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.