Assistant Manager | Testing Automation | Pune | Engineering as a Service/ Operate
Deloitte Advisory23 days ago
Pune, IndiaMid Level
Responsibilities
- Define and maintain QA strategies, test approaches, coverage, test plans, test cases, and test scripts for Power Platform and Copilot Studio solutions.
- Execute functional, smoke, regression, integration, end-to-end, API, performance, and load testing across applications, workflows, APIs, and conversational AI experiences.
- Validate Dataverse, Azure Databricks, Azure Storage, Power Automate workflows, connectors, security roles, relationships, and data integrity rules.
- Design and execute multi-turn chatbot and conversational AI scenarios, including ambiguity handling, fallback behavior, error recovery, and model or configuration changes.
- Test REST services, Azure ML endpoints, custom integrations, data pipelines, and AI/ML outputs using tools such as Postman and JMeter.
- Develop and maintain API automation, regression suites, and automated chatbot-response validation using pattern matching, similarity scoring, and semantic validation.
- Document and track defects using Azure DevOps, Jira, or equivalent tools, and communicate test status, risks, and release readiness.
- Collaborate with developers, data engineers, data scientists, product owners, and business stakeholders on acceptance criteria and non-functional requirements.
- Contribute reusable test assets, automation frameworks, QA practices, performance reports, and statistical checks for model behavior.
Requirements
- At least 3 years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing methods, including NLU, multi-turn flows, and fallback handling.
- Strong understanding of software testing principles, test design, execution, defect lifecycle, traceability, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, with Python preferred.
- Hands-on performance testing experience using JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design and edge-case evaluation for AI agents.
- Preferred qualifications include Microsoft certifications in Power Platform or Data Analytics/AI, Azure cloud testing experience, accessibility, usability, and security testing knowledge, CI/CD exposure, Agile/Scrum experience, and familiarity with RAI, LLM-based systems, prompt engineering, RAG architecture, and multi-agent workflows.
Benefits
- Hybrid work arrangement.
- The role supports Engineering as a Service/Operate delivery across Power Platform, Copilot Studio, and data science solutions.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.