Responsibilities
- Design and document test cases with AI-assisted generation, maintenance, coverage expansion, and gap analysis.
- Use LLMs and intelligent agents to convert requirements, user stories, and production incidents into automated test cases.
- Create test automation frameworks, standards, coding practices, branching strategies, and review guidelines.
- Integrate test execution into CI/CD pipelines with fast feedback and real-time reporting.
- Build tools for test generation, flakiness detection, self-healing tests, intelligent exploratory testing, and failure triage.
- Own the health and evolution of the automation framework and improve testing strategies based on releases, incidents, and customer impact.
- Validate product functionality, performance, reliability, and user experience, including the Agent AI platform.
- Work with engineering, product, DevOps, customers, and customer-facing teams to promote quality and prevent defects early.
Requirements
- 10+ years of experience building customer-facing products.
- Ability to write high-quality, maintainable code in at least one programming language.
- Demonstrated experience building an automation framework from scratch, including test categorization, reusability, and CI/CD integration.
- Strong understanding of software testing methodologies, test planning, and test strategy.
- Familiarity with using AI to enhance testing and software development.
- Experience with Git, GitHub, CircleCI, and cloud services such as AWS or GCP.
- Experience testing modern web applications and Electron-based desktop applications.
- Experience with UI and API testing using tools such as Ginkgo and Playwright.
- Experience with performance and stress testing.
- Preferred experience defining QA strategy and execution for a live product, designing test frameworks, and using test reporting tools and technologies.
- People management skills and experience building systems to validate AI systems, including agents, are nice to have.
Tech Stack
Categories
About DevRev
Computer is the most precise, efficient, and safe AI platform for enterprise search, employee service/help desk, and customer support (including voice). It works by unifying all your existing systems and data into a patented, AI-ready knowledge graph: Native Shared Memory. Every tool, every team, every customer conversation lives in this compounding context. So every answer and action is grounded in what your company knows, and how it operates. With permissions and safety guardrails respected, always. PROVEN EFFICIENCY, PRECISION, AND SAFETY We tested Computer against the market-leading AI on enterprise data: – 48% more accurate – 4.4x fewer tokens used – Cost stays flat at 256x data growth (vs. 29% growth) These results are from “Enterprise-Bench” – the AI industry’s first open, vendor-neutral benchmarking tool. Developed with Laude Institute, validated by Professor Alexandros Dimakis (UC Berkeley). The benchmark model, dataset, and traces are all public. (Feel free to get in touch to learn more.) REAL-WORLD RESULTS More and more companies are trusting Computer: – Bolt: 40% faster ticket resolution. 43% cut in live ticket volume. 25% increase in customer retention. – Bill: 70% of support tickets fully resolved without a human. 100% deployment across all market segments in 15 weeks. Up to $6M in annual savings. – $1.1B org*: 2,000+ new hires onboarded in one year without hiring extra IT staff. 10 weeks to full deployment across all teams. *We can’t reveal the name of our (very) happy customer just yet – but we will soon. DevRev is headquartered in Palo Alto, with eight global offices. We’re backed by Khosla Ventures and Mayfield, with $150M+ raised. Founded by Dheeraj Pandey, former co-founder and CEO of Nutanix [NASDAQ: NTNX], and board member at Adobe [NASDAQ: ADBE], alongside Manoj Agarwal, former SVP of Engineering at Nutanix.