1 day ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Design, develop, and execute test plans for AI-driven products and features.
- Evaluate AI model behavior across real-world scenarios, edge cases, and adversarial inputs.
- Test prompt flows, agent behaviors, recommendations, summarization, search, classification, and generative outputs.
- Identify and document hallucinations, inaccurate outputs, bias, unsafe content, latency, and user-experience issues.
- Build automated test frameworks for regression testing and continuous quality assurance.
- Conduct manual exploratory testing for new AI features and workflows.
- Create evaluation metrics and quality rubrics for AI product performance.
- Collaborate with ML engineers and product teams to define success criteria for AI features.
- Monitor production issues, analyze root causes, and drive quality improvements.
- Maintain test documentation, defect tracking, stakeholder reporting, and release-readiness activities.
Requirements
- 2–4 years of experience in software QA, quality engineering, or related roles.
- Basic understanding of LLMs, prompt engineering, embeddings, and RAG.
- Familiarity with Git, Docker, and cloud environments.
- Strong understanding of QA methodologies, testing lifecycle, defect management, test case design, exploratory testing, and regression testing.
- Hands-on experience with test automation tools such as Selenium, Playwright, Cypress, Postman, or similar.
- Experience with API testing and database and backend validation.
- Strong analytical, critical-thinking, problem-solving, communication, and documentation skills.
- Experience testing AI, ML, or GenAI applications is preferred.
- Knowledge of LLM evaluation, prompt testing, RAG systems, or model benchmarking is preferred.
- Familiarity with Python, JavaScript, or automation scripting is preferred.
- Understanding of precision, recall, latency, user satisfaction, and error-rate metrics is preferred.
- Familiarity with AI observability and evaluation tools is preferred.
Benefits
- Hybrid work arrangement requiring an average of two days per week from an HPE office.
- Health and wellbeing benefits supporting physical, financial, and emotional wellbeing.
- Personal and professional development programs and career-growth opportunities.
- Inclusive workplace and reasonable accommodation support for applicants with disabilities.
Tech Stack
Categories
About HPE
Hewlett Packard Enterprise (HPE) builds enterprise IT infrastructure and services, including servers, storage, networking (Aruba), and hybrid edge-to-cloud platforms like HPE GreenLake for businesses and public-sector organizations. Formed in 2015 after Hewlett-Packard’s split, HPE is headquartered in Houston, Texas and trades on the NYSE. It sells hardware, software, and subscription-based managed cloud services to help customers run workloads across data centers, colocation, and public clouds.