Cognizant

AI QA & RAG/LLM Engr

Cognizant
Apply
15 hours ago
Hyderābād, IndiaSenior

Responsibilities

  • Design and implement automated and manual test suites for AI-powered RAG workflows and LLM features across model versions and data pipelines.
  • Develop and maintain Selenium with Java and Playwright end-to-end and regression automation for web clients, service layers, and backend components.
  • Create API test scenarios covering functional behavior, error handling, data contracts, and performance characteristics.
  • Define behavior-driven executable scenarios, acceptance criteria, test strategies, automation architecture, and quality gates.
  • Build reusable automation frameworks for AI inference endpoints, context retrieval components, and orchestration services.
  • Develop test strategies for prompt behavior, grounding quality, hallucination reduction, and response consistency.
  • Analyze test results, incidents, and quality metrics; perform root-cause analysis and improve coverage, test data, and environments.
  • Translate payment and card-processing requirements into test conditions and regression scenarios.
  • Validate concurrency, failure recovery, timeout handling, and resilience for AI and payment services.
  • Integrate automation into continuous integration and delivery pipelines, triage failures, and improve release feedback loops.
  • Coordinate with security and compliance partners on privacy, audit, and regulatory testing requirements.

Requirements

  • Extensive experience in API validation and functional QA, including complex request/response scenarios, boundary conditions, and contract-based checks.
  • Strong proficiency with Selenium and Java automation, including page object patterns, reusable utilities, data-driven testing, and CI integration.
  • Hands-on experience with Playwright for reliable cross-browser and cross-context end-to-end testing.
  • Practical experience applying behavior-driven development and authoring executable specifications.
  • Familiarity with card and payment flows, commercial financial products, transaction authorization, routing, settlement, and message formatting.
  • Exposure to Base24 platforms or similar payment-switching solutions.
  • Ability to work effectively in hybrid arrangements through structured communication, documentation, and proactive coordination.
  • ISTQB Advanced Test Automation Engineer, Certified Selenium Tester, or equivalent enterprise test automation certification.

Benefits

  • Hybrid work model with structured communication, documentation, collaboration tools, and asynchronous review practices.

Tech Stack

JavaSelenium

Categories

Cognizant

About Cognizant

10,000+ employees

Cognizant is a public IT services and consulting firm that designs, builds, and runs enterprise technology, including digital engineering, cloud modernization, data/AI, and managed services. It sells consulting, systems integration, and outsourcing on multi-year engagements to large enterprises in healthcare, banking, retail, communications, and manufacturing. Founded in 1994 and headquartered in Teaneck, New Jersey, Cognizant is NASDAQ-listed (CTSH) and a Fortune 500 company.

Contact me