11 hours ago
Mumbai, IndiaSenior
Responsibilities
- Design, develop, and maintain UI and API automation frameworks using Playwright and TypeScript.
- Automate functional, regression, smoke, integration, and end-to-end test scenarios.
- Build reusable automation components and improve framework scalability and maintainability.
- Validate AI-driven applications, agentic AI workflows, LLM-powered systems, and intelligent agents.
- Design and execute test strategies for AI models, prompts, workflows, and autonomous agent behaviors.
- Develop evaluation frameworks measuring AI response quality, accuracy, reliability, safety, and performance.
- Automate REST API testing and validate request and response payloads.
- Integrate automation suites into CI/CD pipelines and support continuous quality delivery.
- Track defects, perform root cause analysis, and support issue resolution.
- Prepare test plans, test cases, automation scripts, execution reports, and quality metrics.
- Collaborate with developers, product owners, business analysts, and AI/ML teams.
- Mentor junior QA engineers and contribute to automation best practices.
Requirements
- 8–10 years of experience in software testing and automation.
- Strong expertise in UI and API test automation using Playwright and TypeScript.
- Hands-on experience testing agentic AI, AI-driven workflows, LLMs, AI agents, and evaluation frameworks.
- Experience testing AI models, prompts, workflows, autonomous agent behaviors, and AI-based applications.
- Experience with functional, integration, regression, and end-to-end testing.
- Experience with REST API testing and request/response payload validation.
- Experience integrating automation suites into CI/CD pipelines.
- Ability to perform defect tracking, root cause analysis, quality reporting, and stakeholder collaboration.
- Experience mentoring junior QA engineers and contributing to automation standards.
Tech Stack
Categories
About Capco
Capco is a global technology and management consultancy focused on financial services, helping banks, capital markets, insurance, and wealth firms with digital transformation, risk and compliance, and data/AI-enabled modernization. Founded in 1998 and headquartered in London, it operates as a Wipro company. Its business model centers on project-based consulting, managed services, and solution delivery across strategy, engineering, and platforms for regulated institutions.