Senior Associate | Testing Automation | Pune | Engineering as a Service/ Operate
Deloitte Advisory1 day ago
Pune, IndiaSenior
Responsibilities
- Define and maintain QA strategy, test approaches, coverage, test plans, test cases, and test scripts for Power Platform and Copilot Studio solutions.
- Perform functional, smoke, regression, integration, end-to-end, API, performance, and load testing across applications, workflows, APIs, data integrations, and conversational AI experiences.
- Validate Dataverse and Databricks tables and entities, Power Automate flows, relationships, security roles, data integrity rules, pipelines, and Azure ML integrations.
- Design and execute conversational AI test scenarios covering multi-turn context, ambiguity handling, fallback behavior, error recovery, configuration changes, connector changes, and model updates.
- Use Postman, Python, JMeter, Selenium, or LoadRunner to automate API, regression, chatbot response, performance, and workflow validation.
- Identify, document, and track defects using Azure DevOps, Jira, or equivalent tools.
- Communicate test status, risks, defects, and release readiness to stakeholders and collaborate with developers, data scientists, product owners, and business teams.
- Contribute reusable test assets, automation frameworks, QA best practices, acceptance criteria, non-functional requirements, and performance reports.
Requirements
- 3+ years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling.
- Strong understanding of software testing principles, test design, execution, defect lifecycle, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, with Python preferred.
- Hands-on performance testing experience using JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design and edge-case evaluation for AI agent behavior.
- Experience developing and maintaining automation scripts for API testing, regression test suites, and chat-flow validation.
- Experience building automated chatbot-response validation using pattern matching, similarity scoring, and semantic validation where applicable.
- Preferred: Microsoft certifications in Power Platform or Data Analytics/AI.
- Preferred: cloud-based testing experience, especially Azure; accessibility, usability, and security testing knowledge; CI/CD and performance-testing integration exposure; Agile/Scrum experience; Azure DevOps pipelines for Power Platform or Copilot deployments; RAI principles; LLM systems, prompt engineering, RAG architecture, and multi-agent workflows.
Benefits
- Hybrid work arrangement.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.