Test Analyst, AI
MUFG Pension & Market Services2 months ago
India (city not specified)Mid Level
Responsibilities
- Develop and execute test strategies, plans, cases, scripts, and automated frameworks for AI, ML, generative AI, API, integration, regression, system, user acceptance, and end-to-end testing.
- Validate AI model outputs, prompts, responses, data quality, data integrity, data lineage, accuracy, reliability, performance, fairness, explainability, bias, hallucinations, robustness, and compliance.
- Integrate automated testing with CI/CD pipelines and manage test-suite execution, results analysis, defect tracking, troubleshooting, reporting, and resolution support.
- Identify and document quality, model, data, security, privacy, ethical, compliance, and governance risks and maintain audit-ready test evidence.
- Research and adopt AI-assisted testing tools, automation techniques, methodologies, and best practices to improve testing efficiency, coverage, and quality.
- Collaborate with developers, business analysts, product owners, project managers, and other stakeholders to define requirements, scenarios, acceptance criteria, and quality measures.
- Provide guidance, knowledge sharing, and training on AI testing, automation technologies, and quality engineering practices.
Requirements
- At least 3 years of experience in quality engineering, test automation, and AI-driven testing.
- At least one of Selenium, Appium, or UFT/OpenText, plus experience with Python, Maven, Postman, REST APIs, SoapUI, Cortex, and Snowflake.
- Experience validating AI/ML applications, including model testing, data validation, prompt testing, response evaluation, hallucination detection, bias and fairness testing, explainability validation, adversarial testing, and model-performance assessment.
- Strong understanding of software testing principles, test planning, test design, execution, defect management, reporting, governance, quality assurance, SDLC, and SQA processes.
- Experience with CI/CD and DevOps practices using Jenkins, Azure DevOps, Azure Repos, Bitbucket, Git, Docker, and Kubernetes.
- Experience with cloud platforms, data validation, API testing, integration testing, and end-to-end testing in complex enterprise environments.
- Preferred experience includes 2 or more years in Retirement Solutions, Financial Services, or BFSI domains.
- Strong analytical, problem-solving, communication, collaboration, attention-to-detail, and continuous-learning skills.
Tech Stack
Categories
About MUFG Pension & Market Services
MUFG Pension & Market Services provides pension administration and corporate markets platforms for superannuation funds and listed companies, including registry services, employee share plans, meetings/proxy management, and related data and compliance solutions. It operates through MUFG Retirement Solutions and MUFG Corporate Markets, delivering software-enabled managed services and support. Headquartered in Sydney, it is a member of MUFG, the global financial group, and serves clients across multiple regions.