3 days ago
Bengaluru, IndiaSenior
Responsibilities
- Build, maintain, and execute automated functional, integration, regression, UI, API, and end-to-end test suites.
- Design and execute REST API tests for application services and AI/model endpoints, including validation, contract testing, and negative testing.
- Validate LLM responses, GenAI behavior, RAG pipelines, agentic workflows, and AI application outputs against defined datasets and evaluation criteria.
- Integrate automated tests into CI/CD pipelines using Jenkins, GitHub Actions, or Azure DevOps.
- Execute and validate tests for applications deployed in AWS and Azure environments.
- Log, track, and triage defects using Jira or HP ALM and collaborate with developers and DevOps engineers on resolution.
- Prepare test cases, test data, execution reports, coverage metrics, and AI-specific testing documentation.
- Support senior QA engineers and test leads with test plans and strategies for AI and GenAI features.
- Stay current with AI/LLM testing methodologies, tools, and industry practices.
Requirements
- At least 3 years of hands-on experience in QA or test automation engineering, particularly for AI applications.
- Bachelor’s degree in computer science, information technology, electronics, mathematics, software engineering, or a related field; a master’s degree is a plus.
- Strong programming skills in Java or Python for test script development.
- Hands-on experience with Selenium, Cypress, JMeter, or Playwright.
- Experience with REST API testing using tools such as Postman or RestAssured.
- Practical experience in functional, integration, and regression testing.
- Experience integrating automated tests into CI/CD pipelines using Jenkins, GitHub Actions, or Azure DevOps.
- Working knowledge of Git and GitHub for version control.
- Understanding of cloud testing concepts on AWS and Azure, with GCP exposure preferred.
- Foundational understanding of AI concepts, LLMs, and AI-specific testing considerations.
- Familiarity with Jira or HP ALM for test and defect management.
- Exposure to Ragas, DeepEval, Promptfoo, LangSmith, or Langfuse is preferred.
- Exposure to RAG pipelines, agentic workflows, conversational AI, chatbot applications, JMeter performance testing, Docker, Kubernetes, responsible AI testing, and Agile/Scrum is preferred.
- Preferred certifications include ISTQB Foundation Level, AWS/Azure/GCP cloud certifications, and Agile/Scrum certifications.
Benefits
- Hybrid work arrangement in India with a regular, day-shift position.
- Hands-on experience, mentorship, and learning opportunities in AI-powered transformation.
- Opportunity to work with GenAI, agentic AI, and advanced technology solutions for global enterprises.
- Values-driven and inclusive work environment with equal-opportunity employment practices.
Tech Stack
Apache JMeterAWSAzureCypressDockerGitGitHub ActionsGoogle Cloud PlatformJavaJenkinsKubernetesPostmanPythonSelenium
Categories
About Genpact
Genpact is a global professional services and technology firm that runs and transforms mission-critical operations for large enterprises through consulting, managed services, and AI- and analytics-driven platforms. It serves industries such as banking, insurance, healthcare, and manufacturing/supply chain, modernizing finance, risk, customer service, and back-office processes. Headquartered in New York and listed on the NYSE (G), Genpact originated within GE before becoming an independent public company.