17 hours ago
Bengaluru, IndiaSenior
Responsibilities
- Build, execute, and maintain UI and API test automation for web applications.
- Develop AI-driven test suites, custom AI agents, agentic workflows, and Model Context Protocol integrations.
- Run LLM and AI-agent evaluations measuring accuracy, latency, and prompt-output consistency.
- Maintain test frameworks, execution hooks, BDD scenarios, and automated test scripts.
- Integrate automated test suites into CI/CD pipelines and participate in code reviews.
- Collaborate with Engineering, Product, and DevOps teams to deliver reliable and high-performing test coverage.
Requirements
- 5–8 years of hands-on experience in software quality engineering.
- Practical experience with UI automation using Playwright and Selenium and API automation using REST Assured and Postman.
- Experience with Java, TypeScript, or JavaScript, plus TestNG Listeners and Playwright Custom Reporters or Fixtures.
- Experience with AI-assisted test generation, debugging, failure analysis, custom AI agents, agentic workflows, and MCP integrations.
- Experience with Ragas, DeepEval, or Promptfoo for AI and LLM evaluation is relevant to the role.
- Bachelor’s degree in computer science or equivalent.
- Familiarity with modern Playwright and TypeScript test setups, OpenSpec or Spec Kit, Python, prompt engineering, RAG, and multi-agent concepts is preferred.
- Exposure to Jira, qTest, Jenkins, GitHub Actions, and OpenAPI/Swagger is preferred.
Tech Stack
Categories
About Conga
Conga builds enterprise SaaS for revenue lifecycle management, including CPQ, contract lifecycle management, billing, eSignature, and document generation with deep Salesforce integration. It sells subscriptions to businesses with complex commercial operations, helping unify quoting, contracting, and fulfillment. Founded in 2006 and headquartered in Houston, the privately held company reports more than 10,000 customers worldwide, including over half of the Fortune 100.