CT Engineering-Product Testing-Test Lead
Ernst and Young27 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Lead testing activities, establish timelines, supervise testers, and define test scope and environments.
- Create and implement comprehensive functional and AI testing strategies, standards, metrics, and risk-based coverage.
- Architect, build, and maintain reusable automation frameworks for UI, functional, API, backend integration, and AI testing.
- Integrate automated testing and reporting frameworks with CI/CD pipelines and reduce manual testing effort.
- Evaluate automation tools, including AI-assisted test generation and validation solutions such as DeepEval.
- Design and execute tests for RAG frameworks and multi-agent systems, validating retrieval, generation, reasoning, and orchestration accuracy.
- Conduct bias, fairness, and ethical compliance testing for AI models.
- Manage test execution, reporting, defect triage, prioritization, and release-readiness decisions.
- Lead and mentor cross-functional testing teams and define strategic testing roadmaps for AI-driven products.
- Develop stakeholder relationships and communicate quality metrics, risks, recommendations, and performance indicators.
Requirements
- Bachelor’s degree in Computer Science, Engineering, IT, or a related field.
- 12+ years of relevant work experience.
- Ability to implement automation strategies and guide a testing team.
- Hands-on experience building and adopting large-scale automation frameworks across UI, functional, API, and backend integration testing.
- Scripting or coding experience with Selenium and Java or Python.
- Experience with testing concepts, standards, automation and performance strategies, and Agile methodology.
- Experience with Azure DevOps or another relevant defect-management tool and CI/CD environments.
- Broad understanding of AI testing, including predictive analytics, intelligent test-case generation, defect detection, RAG validation, and agentic systems.
- Strong analytical, problem-solving, leadership, communication, collaboration, and stakeholder-management skills.
- Experience supporting small to medium-sized projects and tracking relevant performance indicators and metrics.
- Ability to work across virtual, cross-cultural, and cross-border teams and adapt to shifting priorities and ambiguity.
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.