3 hours ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Build, run, and maintain UI and API test automation for web applications.
- Develop AI-assisted test generation, debugging, failure analysis, agentic workflows, and Model Context Protocol integrations.
- Support LLM and AI agent evaluations measuring accuracy, latency, and prompt output consistency.
- Build and maintain automated test scripts, BDD scenarios, and framework updates.
- Integrate automated test suites into CI/CD pipelines and collaborate with Engineering, Product, and DevOps teams.
- Participate in code reviews and deliver reliable, high-performing test coverage.
Requirements
- 3 to 5 years of hands-on Software Quality Engineering experience.
- Practical experience with UI automation using Playwright and Selenium and API automation using REST Assured and Postman.
- Programming experience with Java, TypeScript, or JavaScript.
- Experience with TestNG Listeners and Playwright Custom Reporters or Fixtures.
- Bachelor’s degree in computer science or equivalent.
- Experience or familiarity with AI-assisted testing, custom AI agents, agentic workflows, and MCP integrations.
- Familiarity with Ragas, DeepEval, or Promptfoo for AI evaluation and benchmarking.
- Familiarity with Playwright/TypeScript test setups, Spec-Driven Development, Python, LLM prompt engineering, RAG, and multi-agent concepts is preferred.
- Exposure to Jira, qTest, Jenkins, GitHub Actions, and OpenAPI/Swagger is preferred.
Tech Stack
Categories
About Conga
Conga builds enterprise SaaS for revenue lifecycle management, including CPQ, contract lifecycle management, billing, eSignature, and document generation with deep Salesforce integration. It sells subscriptions to businesses with complex commercial operations, helping unify quoting, contracting, and fulfillment. Founded in 2006 and headquartered in Houston, the privately held company reports more than 10,000 customers worldwide, including over half of the Fortune 100.