Lead Senior Associate | Testing Automation | Pune | Engineering as a Service/ Operate
Deloitte Advisory20 days ago
Pune, IndiaStaff+
Responsibilities
- Define and maintain QA strategy, test approaches, coverage, plans, cases, and scripts for Power Platform and Copilot Studio solutions.
- Execute functional, smoke, regression, integration, end-to-end, performance, load, API, data integration, and conversational AI testing.
- Validate Dataverse and Databricks data, Power Automate workflows, relationships, security roles, data integrity rules, and Azure ML integrations.
- Design conversation test scenarios covering multi-turn context, ambiguity, fallback handling, error recovery, prompts, and AI agent behavior.
- Develop and maintain automation for API testing, regression suites, chatbot responses, pattern matching, similarity scoring, and semantic validation.
- Use JMeter or LoadRunner to simulate traffic, analyze results, and produce performance reports.
- Identify, document, and track defects using Azure DevOps, Jira, or equivalent tools.
- Communicate test status, risks, defects, and release readiness to stakeholders.
- Collaborate with developers, data engineers, data scientists, product owners, and business stakeholders on acceptance criteria and non-functional requirements.
- Contribute reusable QA assets, automation frameworks, best practices, and performance-testing integration with delivery pipelines.
Requirements
- At least 3 years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- BE, BTech, MCA, BCA, BSc, MSc, or another graduate qualification.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing methods, including NLU, multi-turn flows, and fallback handling.
- Strong understanding of software testing principles, test design, execution, defect lifecycle, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, preferably with Python.
- Hands-on performance testing with JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design and edge-case evaluation for AI agents.
- Preferred: Microsoft certifications in Power Platform or Data Analytics/AI; Azure cloud testing experience; accessibility, usability, and security testing knowledge; CI/CD and Agile/Scrum experience; Azure DevOps pipeline experience; and knowledge of RAI, LLM systems, prompt engineering, RAG architecture, and multi-agent workflows.
Benefits
- Hybrid work arrangement in Pune.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.