Testing - AI Test Lead Senior
Ernst and Young1 day ago
Bengaluru, IndiaStaff+
Responsibilities
- Define and own test strategy, planning, execution, reporting, and closure for AI-based systems.
- Validate AI models across functional, performance, and statistical metrics.
- Perform data collection, augmentation, exploratory analysis, bias detection, privacy assessment, and other data validation activities.
- Identify discrepancies, anomalies, and risks in model outputs and coordinate timely resolution with development teams.
- Lead defect management and collaborate with cross-functional teams to resolve issues.
- Engage with client stakeholders, provide status updates, and resolve issues.
- Prepare test reports and support sign-off and closure activities.
- Lead distributed teams across geographies and ensure delivery excellence.
Requirements
- Strong understanding of AI/ML concepts, LLMs, and Agentic AI systems.
- Hands-on experience with bias testing, drift testing, metamorphic testing, and back-to-back testing.
- Expertise with test automation tools such as Selenium, Playwright, and PyTest.
- Proficiency in Python programming and AI evaluation frameworks.
- Exposure to GitHub Copilot or similar AI-assisted development tools.
- Understanding of cloud platforms such as Azure, AWS, or GCP.
- Strong analytical, problem-solving, and communication skills.
- Experience working in Agile environments.
Benefits
- Flexible work environment with globally connected teams.
- Professional development, continuous learning, mentorship, and opportunities to build skills and take on leadership roles.
- Diverse, equitable, and inclusive workplace culture.
- Health and wellness packages, rewards, and learning opportunities.
Tech Stack
Categories