QA Engineer
Sutherland6 days ago
Chennai, IndiaSenior
Responsibilities
- Build test suites that validate agent outputs against golden-record datasets.
- Define test datasets and accuracy benchmarks for document and text-processing systems.
- Track and report accuracy and turnaround-time metrics for baselining exercises.
- Run regression testing when agent or prompt configurations change.
- Provide technical evidence and findings to the human QA function for final sign-off in regulated processes.
Requirements
- 5+ years of QA or test engineering experience.
- Ideally, experience validating ML/LLM outputs rather than only deterministic software testing.
- Experience defining test datasets and accuracy benchmarks for document or text-processing systems.
- Domain process familiarity is a plus for developing realistic test scenarios.
Categories