1 day ago
Remote, United StatesSenior
Base Salary
$115k - $120k/yr
Responsibilities
- Develop and manage comprehensive functional, regression, accessibility, performance, and AI-output test strategies.
- Lead Playwright end-to-end and Vitest component test automation for React and Next.js applications.
- Build API and contract tests for backend-for-frontend endpoints, .NET and Python services, and AG-UI event streams.
- Test streaming behavior, retries, timeouts, resilience, load, and performance for endpoints and data-heavy screens.
- Integrate automated test suites into GitHub Actions and maintain reliable results.
- Conduct accessibility testing with axe-core and manual testing using JAWS, NVDA, and VoiceOver against WCAG 2.1/2.2 AA and Section 508.
- Analyze, prioritize, document, and report defects, test results, quality metrics, and release readiness.
- Mentor quality engineers and establish testing automation patterns and standards.
- Evaluate AI-assisted tests, scripts, and analyses for correctness, security, maintainability, compliance, and business appropriateness.
- Follow governance requirements for AI usage, intellectual property, security, privacy, PHI handling, and Responsible AI practices.
Requirements
- 5+ years of software quality assurance experience, including 3+ years of hands-on test automation for modern web applications.
- Strong hands-on Playwright experience using TypeScript or JavaScript.
- Experience with Vitest or Jest, React Testing Library, and testing React web applications with asynchronous and streaming behavior.
- Hands-on accessibility testing experience with axe-core, JAWS, NVDA, VoiceOver, WCAG 2.1/2.2 AA, and Section 508.
- Experience with API testing, contract testing, and schema-based validation of APIs or event streams.
- Experience with load or performance testing tools such as k6 or JMeter.
- Experience creating and maintaining CI/CD automation jobs with GitHub Actions and YAML, plus Git version control.
- Knowledge of test management and defect tracking tools such as JIRA or ALM.
- Knowledge of functional, regression, accessibility, and performance testing methodologies and Agile development environments.
- Strong troubleshooting, problem-solving, communication, collaboration, and mentoring skills.
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.
- Preferred qualifications include AI or LLM output evaluation, AG-UI, CopilotKit, Vercel AI SDK, Python test tooling, GitHub Copilot, Playwright MCP, FHIR R4, Da Vinci PAS, OpenTelemetry, and healthcare or regulated-environment experience.
Benefits
- Comprehensive benefits, including health insurance benefits, for qualifying employees.
- Work/life balance, flexibility, autonomy, and an inclusive workplace culture.
- The role requires a home high-speed internet connection exceeding 10 Mbps.
- Hiring includes identity verification, a government-issued photo ID, background check, in-person I-9 verification, and possible drug screening; final interviews may require onsite attendance.
Tech Stack
Categories
About Evolent
Evolent is a public health care company that provides value-based care and specialty care management solutions to health plans and providers. Its platform combines clinical programs, software, and analytics to manage oncology, cardiology, musculoskeletal and other complex conditions, and supports payment models for Medicare Advantage, Medicaid and commercial plans. Founded in 2011 and headquartered in Arlington, Virginia, Evolent trades on the NYSE under the ticker EVH.