7 days ago
Chennai, IndiaMid Level / Senior
Responsibilities
- Own and demonstrate the quality of a software product.
- Test LLM-based, NLP, conversational AI, chatbot, voice assistant, virtual agent, RAG, and agentic AI systems.
- Develop automated testing and scripting approaches using Python.
- Design evaluations for non-deterministic outputs using golden datasets, rubrics, LLM-as-judge scoring, human review workflows, and statistical pass criteria.
- Assess conversational AI behavior involving prompting, context windows, function/tool calling, retrieval, and characteristic system failures.
- Validate airline booking, post-booking, and check-in workflows.
Requirements
- 4+ years of software quality engineering experience.
- Strong Python scripting ability.
- Hands-on experience testing LLM-based, NLP, or conversational systems.
- Practical understanding of prompting, context windows, function/tool calling, retrieval, and conversational AI failure modes.
- Experience designing evaluation approaches for non-deterministic outputs.
- Strong airline or travel domain knowledge, particularly booking, post-booking, and check-in flows.
Benefits
- Location: Noida or Kolkata.
About Cognizant
Cognizant (Nasdaq: CTSH) is an AI Builder and technology services provider, bridging the gap between AI investment and enterprise value. We build full-stack AI solutions powered by deep industry, process and engineering expertise — embedding an organization's unique context into technology systems that amplify human potential and drive tangible outcomes. From strategy to deployment, we help global enterprises move from AI ambition to AI impact and stay ahead in a fast-changing world. See how at cognizant.ai | Follow us @cognizant