Lead Senior Associate | Testing Automation | Bengaluru | Engineering as a Service/ Operate
Deloitte Advisory1 day ago
Bengaluru, IndiaStaff+
Responsibilities
- Define and maintain QA strategy, test approaches, coverage, reusable test assets, and automation frameworks for Power Platform and Copilot Studio solutions.
- Create, review, and execute test plans, test cases, and test scripts across SDLC phases, including functional, smoke, regression, integration, and end-to-end testing.
- Validate Dataverse and Databricks tables and entities, Power Automate workflows, relationships, security roles, data integrity rules, integrations, and pipelines.
- Design and execute conversational AI test scenarios covering multi-turn context, ambiguity handling, fallback behavior, error recovery, prompt edge cases, and model or configuration changes.
- Perform API testing for REST services, Azure ML endpoints, custom integrations, workflows, and data services using Postman and scripted validation.
- Plan and execute performance and load tests with JMeter or LoadRunner, including traffic simulation, analysis, and reporting.
- Develop and maintain automated API, regression, and chatbot test suites using Python, Selenium, pattern matching, similarity scoring, and semantic validation.
- Identify and track defects using Azure DevOps, Jira, or equivalent tools, and communicate test status, risks, and release readiness to stakeholders.
- Collaborate with developers, data engineers, data scientists, product owners, and business stakeholders on acceptance criteria and non-functional requirements.
Requirements
- At least 3 years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling.
- Strong understanding of software testing principles, test design, execution, defect lifecycle, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, with Python preferred.
- Hands-on performance testing experience using JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design and edge-case evaluation for AI agent behavior.
- Preferred Microsoft certifications in Power Platform or Data Analytics/AI.
- Preferred experience with Azure-based testing environments, accessibility, usability, security testing, CI/CD pipelines, and performance-test integration.
- Preferred exposure to Agile/Scrum projects and Azure DevOps pipelines for Power Platform or Copilot deployments.
- Understanding of RAI principles, LLM-based systems, prompt engineering basics, RAG architecture, and multi-agent workflows.
Benefits
- Hybrid work arrangement.
- The role supports Engineering as a Service/Operate delivery across Power Platform, Copilot Studio, data science, and AI/ML solutions.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.