Senior Test Analyst, AI
MUFG Pension & Market Services2 months ago
India (city not specified)Senior
Responsibilities
- Develop and execute testing strategies for AI, machine learning, and generative AI solutions.
- Design, develop, execute, and maintain automated test cases, test scripts, and AI test frameworks.
- Perform functional, integration, API, system, regression, user acceptance, end-to-end, model validation, data validation, prompt, response, and adversarial testing.
- Validate AI model outputs for accuracy, consistency, bias, fairness, explainability, hallucinations, robustness, reliability, and business alignment.
- Validate data quality, integrity, lineage, environments, model releases, and the full AI data lifecycle.
- Integrate test automation with CI/CD pipelines and manage automated test-suite execution and results.
- Lead defect triage, root cause analysis, quality risk management, issue resolution, and test reporting.
- Establish AI testing governance, responsible AI validation, regulatory controls, standards, and audit documentation.
- Research and recommend AI testing methodologies, LLM evaluation frameworks, benchmarking techniques, intelligent automation, and synthetic test-data approaches.
- Provide technical leadership, mentoring, coaching, onboarding, and knowledge sharing for testers and project teams.
Requirements
- 5+ years of experience in Quality Engineering, Test Automation, and AI-driven testing.
- At least one of Selenium, Appium, or UFT/OpenText, plus experience with Python, Maven, Postman, REST APIs, SoapUI, Cortex, and Snowflake.
- Experience designing and executing AI-powered test automation frameworks and validating AI/ML applications, including prompt testing, response evaluation, bias and fairness assessment, hallucination detection, adversarial testing, explainability validation, and performance assessment.
- Understanding of software testing principles, test strategy, planning, design, execution, defect management, reporting, governance, SDLC, and SQA processes.
- Experience with CI/CD pipelines and DevOps practices using Jenkins, Azure DevOps, Azure Repos, Bitbucket, Git, Docker, and Kubernetes.
- Experience with API testing, integration testing, data validation, cloud platforms, complex enterprise environments, and AI-assisted testing tools is desirable.
- Experience with Selenium, Appium, UFT/OpenText, Python, Maven, Postman, REST Assured, JIRA, Azure DevOps, and end-to-end data-lifecycle automation.
- Preferred experience includes 4+ years in Retirement Solutions, Financial Services, or BFSI domains.
- Strong analytical, problem-solving, troubleshooting, communication, collaboration, attention to detail, prioritization, and independent-working skills.
Tech Stack
Categories
About MUFG Pension & Market Services
MUFG Pension & Market Services provides pension administration and corporate markets platforms for superannuation funds and listed companies, including registry services, employee share plans, meetings/proxy management, and related data and compliance solutions. It operates through MUFG Retirement Solutions and MUFG Corporate Markets, delivering software-enabled managed services and support. Headquartered in Sydney, it is a member of MUFG, the global financial group, and serves clients across multiple regions.