7 months ago
Delhi, IndiaSenior
Responsibilities
- Own end-to-end product quality across AI workflows, including onboarding, chat interactions, multi-file edits, agentic task execution, and autonomous workflows.
- Design and execute functional, regression, integration, exploratory, and end-to-end test plans across product surfaces and releases.
- Break down complex flows into testable scenarios, including edge cases, race conditions, state recovery failures, and production-like usage patterns.
- Reproduce, document, and debug issues across UI, orchestration/system, and unexpected AI behavior layers.
- Partner with engineering and product to define completion criteria, set quality standards, and ensure release readiness.
- Establish QA playbooks, test processes, and automation while helping evolve CI/CD and testing practices.
Requirements
- At least 5 years of QA or test engineering experience testing complex, multi-step product workflows.
- Deep expertise in functional, regression, exploratory, integration, and end-to-end testing.
- Ability to read and write code in Python, TypeScript, or a similar language and navigate codebases.
- User-first testing mindset with strong attention to detail and debugging instincts.
- Familiarity with CI/CD and test automation frameworks in fast-moving, release-driven environments.
- Ability to overlap with US time zones, with potential weekend availability during release cycles.
- Experience testing AI-powered products with nondeterministic outputs is a strong plus.
- Experience testing IDE plugins, extensions, or developer tools is a strong plus.
- Familiarity with AI coding tools such as Windsurf, Copilot, Cursor, or Devin is a strong plus.
- Prior software engineering experience with shipped production code is a strong plus.
Benefits
- Schedule flexibility with required overlap with US time zones.
- Weekend availability may be required during release cycles.
- Reasonable accommodations are available throughout the hiring process.
Tech Stack
Categories
About Cognition
Cognition is an applied AI company building end-to-end software agents for engineering teams. Its flagship product, Devin, is an AI software engineer that collaborates with developers to plan tasks, write code, run tests, fix bugs, and ship changes across common tools. The company is privately held, founded in 2023, and headquartered in San Francisco.