Generative AI Quality Engineer– Tech Lead
State Street16 hours ago
Hyderābād, IndiaMid Level / Senior
Responsibilities
- Analyze business and technical specifications and translate customer or business-user needs into test scenarios.
- Write functional test cases and execute regression testing.
- Report bugs, verify fixes, and maintain the bug tracking system.
- Maintain and execute automated tests using Selenium with Python and Pytest.
- Automate web services using Postman and/or Python.
- Execute LLM test plans covering prompt validation, accuracy checks, relevance evaluation, and basic safety evaluation.
- Test AI-driven agents and workflows for reliability, robustness, and integration quality.
Requirements
- 3–8 years of software quality assurance testing experience.
- Experience with Selenium and Python for test automation.
- Experience with functional, regression, automated, LLM, and AI-agent testing.
- Experience with BDD and TDD using Gherkin and with Jira.
- Experience with tools such as PyCharm, VS Code, Git, Fiddler, Postman, SoapUI, JMeter, Jenkins, and Jira.
- Ability to analyze requirements, create test scenarios, solve problems, manage priorities, and meet deadlines.
- Familiarity with LLM prompt-response validation and evaluation of model accuracy and relevance.
- Hands-on LLM and agent testing exposure is highly preferred.
- Exposure to LLM red teaming, AI governance, bias detection, safety validation, OpenAI Evals, Ragas, or custom benchmarking suites is preferred.
- Basic understanding of artificial intelligence and machine learning concepts is preferred.
Benefits
- Hybrid work model allowing work from home and office work based on needs and role requirements; the work schedule is also listed as on-premise.
- Inclusive development opportunities, flexible work-life support, paid volunteer days, and employee networks.
About State Street
State Street is a global custodian bank and asset manager serving institutional investors with investment servicing, fund accounting, trading/FX, data, and index/active strategies. Its products include State Street Global Advisors’ funds and ETFs, the Charles River Investment Management Solution, and the front-to-back State Street Alpha platform. Founded in 1792 and headquartered in Boston, the company is publicly traded on the NYSE (ticker: STT) and operates across major markets worldwide.