2 months ago
Remote, United StatesMid Level
Responsibilities
- Build test plans and validate new features from requirements through production release.
- Test integrations and APIs, including authentication, permissions, webhooks, retries, pagination, rate limits, error handling, and third-party dependencies.
- Validate end-to-end customer journeys across dashboards, SDKs, APIs, connectors, and agent workflows.
- Perform exploratory testing to uncover edge cases, unexpected interactions, and usability issues.
- Build and execute regression suites for high-risk and frequently used product areas.
- Evaluate AI-native tool-calling agents and other non-deterministic workflows.
- Automate repeatable API, integration, and UI test cases where automation improves release confidence.
- Investigate production issues using logs, network traces, API responses, and production signals.
- Write clear bug reports, drive defects through resolution, verify fixes, and prevent regressions.
- Partner with engineers and product managers to identify risks, define acceptance criteria, and support release decisions.
Requirements
- Strong hands-on experience testing modern web applications, APIs, or developer products.
- Excellent exploratory testing and debugging skills, including the ability to turn requirements into structured test plans and high-value test cases.
- Experience with functional, integration, API, end-to-end, and regression testing.
- Strong understanding of defect severity, prioritization, release risk, and quality signoff.
- Experience testing REST APIs with tools such as Postman, Bruno, Insomnia, or equivalent.
- Ability to reason about authentication, permissions, retries, webhooks, pagination, rate limits, asynchronous workflows, and eventual consistency.
- Working knowledge of SQL and ability to validate data while debugging issues.
- Ability to write or maintain automated tests using JavaScript, TypeScript, Python, or a similar language.
- Familiarity with Playwright, Cypress, pytest, or equivalent testing frameworks.
- Understanding of automated quality gates, flaky-test management, and regression coverage.
- Ability to investigate failures using browser developer tools, logs, API payloads, and network traces.
- Strong ownership, precise defect reporting, clear risk communication, independent execution, and effective collaboration.
- Availability and responsiveness during Pacific Time working hours.
- Preferred experience with developer tools, SDKs, workflow automation products, integration platforms, OAuth, API keys, webhooks, third-party applications, AI agents, LLM evaluation, MCP, tool-calling systems, cross-browser and cross-device testing, observability tools, production incidents, or early-stage QA process improvement.
Benefits
- Globally remote position.
- Must work a full schedule aligned with the Pacific Time team.
Tech Stack
Categories
About Composio
At Composio, We're building the future of Agentic Actions. We are empowering AI Agents to interact with hundreds of applications/tools and take autonomous actions, streamlining workflows and unlocking new possibilities. We're always on a lookout for great talent and check out our careers page!