T&T-EAID-Associate Director- QA Automation Architect-Playwright+ typescript-Bengaluru-Engineering
Deloitte Advisory1 month ago
Bengaluru, IndiaStaff+
Responsibilities
- Define and drive QA strategy and reusable automation architecture for AI/LLM-based platforms.
- Build UI, API, backend, and CMS automation frameworks using Playwright, TypeScript, Python, and Behave.
- Develop LLM evaluation strategies covering accuracy, relevance, bias, fairness, safety, toxicity, harmful prompts, and edge cases.
- Establish Responsible AI testing standards, governance, traceability, auditability, prompt versioning, dataset control, and experiment tracking.
- Integrate automated testing into CI/CD pipelines with quality gates, parallel execution, and consistent environments.
- Validate AEM components, workflows, content publishing pipelines, APIs, AI services, and CMS platforms.
- Drive performance and reliability testing for latency, throughput, scalability, and model inference bottlenecks.
- Define quality KPIs and SLAs and use logs, traces, dashboards, and observability tools to assess system behavior.
- Mentor QA engineers and SDETs and act as a thought leader in AI quality engineering.
Requirements
- 13+ years of experience in QA and automation with architect-level experience.
- Strong, mandatory hands-on expertise in Playwright and TypeScript.
- Proven hands-on experience testing and validating AI/LLM systems.
- Deep experience building scalable automation frameworks.
- Experience with API testing using Playwright, Postman, and Rest Assured.
- Experience with BDD using Python and Behave.
- Experience with CI/CD tools such as Jenkins, GitHub Actions, and Azure DevOps.
- Understanding of Agile, DevOps, and modern engineering practices.
- Preferred experience with production Generative AI systems, Responsible AI or AI governance, cloud environments, Docker, Kubernetes, microservices, prompt engineering, ML/Data Science teams, and Adobe Experience Manager.
- Preferred experience in regulated domains such as Fintech, Healthcare, or SaaS.
- BE or BTech educational background.
Benefits
- Work on cutting-edge AI/LLM platforms.
- Opportunity to shape enterprise AI quality standards.
- High-impact role with architectural ownership and visibility.
- Collaborative environment with cross-functional innovation.
- Location: Bengaluru.
Tech Stack
Categories
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.