Assistant Manager | Testing Automation | Hyderabad | Engineering as a Service/ Operate
Deloitte Advisory1 day ago
Hyderābād, IndiaStaff+
Responsibilities
- Define and maintain QA strategies, test approaches, coverage, plans, cases, and scripts for Power Platform and Copilot Studio solutions.
- Perform functional, smoke, regression, integration, end-to-end, API, performance, and load testing across applications, workflows, APIs, connectors, and conversational AI experiences.
- Validate Dataverse and Databricks data structures, Power Automate flows, relationships, security roles, data integrity rules, integrations, and pipelines.
- Design and execute conversational AI test scenarios covering multi-turn context, ambiguity, fallback handling, error recovery, prompts, and model/version changes.
- Test REST services, Azure ML endpoints, custom integrations, workflows, and APIs using Postman, JMeter, Python, or LoadRunner.
- Develop automated API, regression, and chatbot validation suites using pattern matching, similarity scoring, and semantic validation where applicable.
- Use JMeter to simulate traffic patterns, analyze results, and produce performance reports.
- Identify, document, and track defects using Azure DevOps, Jira, or equivalent tools.
- Communicate test status, risks, acceptance criteria, non-functional requirements, and release readiness to stakeholders.
- Collaborate with developers, data engineers, data scientists, product owners, and business stakeholders on quality practices and reusable automation assets.
Requirements
- At least 3 years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing methodologies, including NLU and multi-turn flows.
- Strong understanding of software testing principles, test design, execution, defect lifecycle, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, with Python preferred.
- Hands-on performance testing experience using JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design and edge-case evaluation for AI-agent behavior.
- Preferred qualifications include Microsoft certifications in Power Platform or Data Analytics/AI, cloud-based testing experience with Azure, and knowledge of accessibility, usability, and security testing.
- Exposure to CI/CD pipelines, performance-test integration, Agile/Scrum projects, Azure DevOps pipelines, RAI principles, LLM-based systems, prompt engineering, RAG architecture, and multi-agent workflows.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.