13 hours ago
Chennai, IndiaMid Level / Senior
Responsibilities
- Own and improve the quality of software products through software quality engineering and test activities.
- Test conversational AI, LLM-based applications, chatbots, voice assistants, virtual agents, RAG applications, and agentic AI systems.
- Design evaluation approaches for nondeterministic outputs using golden datasets, rubrics, LLM-as-judge scoring, human review workflows, and statistical pass criteria.
- Evaluate conversational AI behavior including prompting, context windows, function and tool calling, retrieval, and characteristic system failure modes.
- Apply quality engineering expertise to airline and travel workflows covering booking, post-booking, and check-in.
Requirements
- 4-9 years of software quality engineering experience, including at least 4 years of relevant experience.
- Demonstrable ownership of a product’s quality.
- Strong scripting ability in Python.
- Hands-on experience testing LLM-based, NLP, or conversational systems such as chatbots, voice assistants, virtual agents, RAG, or agentic applications.
- Practical understanding of prompting, context windows, function and tool calling, retrieval, and conversational AI failure modes.
- Experience designing evaluations for nondeterministic outputs.
- Strong airline or travel-domain knowledge, especially booking, post-booking, and check-in flows.
About Cognizant
Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.