Senior Associate | Testing Automation | Pune | Engineering as a Service/ Operate
Deloitte Advisory20 days ago
Pune, IndiaSenior
Responsibilities
- Define and maintain QA strategy, test approaches, coverage, plans, cases, and scripts across SDLC phases.
- Execute functional, smoke, regression, integration, end-to-end, performance, and load testing.
- Validate Dataverse and Databricks tables and entities, Power Automate flows, relationships, security roles, integrations, and data integrity rules.
- Design and execute conversational AI tests covering multi-turn context, ambiguity handling, fallback behavior, error recovery, and model or configuration changes.
- Perform API testing for REST services, Azure ML endpoints, custom connectors, and integrations using Postman, JMeter, or scripted validation.
- Test data integrations and pipelines involving Azure Databricks, Azure Storage, and Dataverse.
- Use JMeter to simulate traffic patterns and produce performance reports.
- Identify, document, and track defects using Azure DevOps, Jira, or equivalent tools.
- Communicate test status, risks, and release readiness to stakeholders.
- Collaborate with developers, data scientists, product owners, and business stakeholders on acceptance criteria and non-functional requirements.
- Develop reusable QA assets, automation frameworks, API and regression automation scripts, and automated chatbot-response validation using pattern matching, similarity scoring, and semantic validation.
Requirements
- At least 3 years of QA/testing experience, including 1–2 years testing Microsoft Power Platform solutions.
- Bachelor-level or equivalent graduate education such as BE, BTech, MCA, BCA, BSc, or MSc.
- Hands-on experience testing Power Automate workflows and data-centric applications.
- Working knowledge of Dataverse, connectors and custom connectors, Azure Databricks, and Azure Storage.
- Familiarity with Copilot Studio or chatbot testing methodologies, including NLU, multi-turn flows, and fallback handling.
- Strong understanding of software testing principles, test design, execution, defect lifecycle, and reporting.
- Experience with REST API testing using Postman and/or scripted validation, preferably with Python.
- Hands-on performance testing experience using JMeter or LoadRunner, including analysis and reporting.
- Ability to validate AI/ML outputs and collaborate with data teams on statistical checks and model behavior.
- Basic understanding of prompt design and edge-case evaluation for AI agents.
- Preferred qualifications include Microsoft Power Platform or Data Analytics/AI certifications, Azure testing experience, accessibility, usability and security testing knowledge, CI/CD exposure, Azure DevOps pipelines, Agile/Scrum experience, RAI principles, LLM-based systems, prompt engineering, RAG architecture, and multi-agent workflows.
Benefits
- Hybrid work arrangement in Pune.
- The role supports engineering-as-a-service/operate work involving Power Platform, Copilot Studio, data science solutions, and cloud-based testing environments.
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.