Lead Senior Associate | Testing Automation | Pune | Engineering as a Service/ Operate
Deloitte Advisory1 day ago
Pune, IndiaStaff+
Responsibilities
- Define and maintain QA strategy, test approaches, coverage, test plans, test cases, and test scripts across the software development lifecycle.
- Execute functional, smoke, regression, integration, end-to-end, API, performance, and load testing.
- Validate Dataverse, Databricks, Power Automate workflows, connectors, security roles, relationships, data integrity, and Azure-based integrations.
- Design and execute conversational AI test scenarios covering multi-turn context, ambiguity handling, fallback behavior, error recovery, and model or configuration changes.
- Test REST APIs, Azure ML endpoints, custom integrations, data pipelines, and cloud-based solutions using Postman, JMeter, and automation scripts.
- Develop and maintain automated API, regression, and chatbot validation suites using Python, Selenium, and related techniques.
- Identify and track defects using Azure DevOps, Jira, or equivalent tools, and communicate test status, risks, and release readiness.
- Collaborate with developers, data scientists, product owners, and business stakeholders on acceptance criteria, non-functional requirements, and statistical validation.
- Contribute to reusable test assets, automation frameworks, performance-test integration, and QA best practices.
Requirements
- 3+ years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing, including NLU, multi-turn flows, and fallback handling.
- Strong understanding of software testing principles, test design, execution, defect lifecycles, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, with Python preferred.
- Hands-on performance testing experience with JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design, LLM-based systems, RAG architecture, multi-agent workflows, and edge-case evaluation of AI agents.
- Experience developing automation scripts for API testing, regression suites, and chatbot response validation.
- Preferred qualifications include Microsoft Power Platform or Data Analytics/AI certifications, Azure testing experience, accessibility/usability/security testing knowledge, CI/CD exposure, Azure DevOps pipeline experience, Agile/Scrum experience, and understanding of RAI principles.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.