1 day ago
Remote, United StatesMid Level
Base Salary
$91k - $96k/yr
Responsibilities
- Develop, document, and execute test plans and test cases for assigned features.
- Perform exploratory, automated, functional, regression, performance, API, and contract testing.
- Create and maintain Playwright end-to-end tests and Vitest component tests, with familiarity with Jest.
- Execute automated suites in GitHub Actions, investigate failures, and maintain a high pass rate.
- Test streaming, loading, error, slow-response, and failed-agent-response states.
- Create and maintain synthetic test data and ensure protected health information is not used with unapproved tools.
- Run axe-core accessibility checks and manual screen reader tests with JAWS, NVDA, and VoiceOver against WCAG 2.1/2.2 AA.
- Identify, isolate, document, and track defects while collaborating with developers on resolution.
- Analyze results, generate quality metrics, and report software quality status to stakeholders.
- Participate in code reviews, design discussions, sprint planning, Agile ceremonies, peer reviews, and knowledge-sharing sessions.
- Use and validate approved AI-assisted tools for test design, script development, test data generation, documentation, and troubleshooting.
- Follow policies for AI usage, intellectual property, security, privacy, PHI handling, and Responsible AI.
Requirements
- At least 3 years of experience in software quality assurance or testing, including hands-on UI test automation.
- Experience with Playwright or similar end-to-end automation tools, preferably with TypeScript or JavaScript.
- Working knowledge of JavaScript or TypeScript for test automation.
- Familiarity with Vitest or Jest, API testing tools such as Postman, REST APIs, GitHub Actions, Git, and test or defect management tools such as JIRA or ALM.
- Proficiency in functional, regression, and performance testing methodologies.
- Knowledge of Agile methodologies and experience in an Agile development environment.
- Strong analytical, troubleshooting, problem-solving, communication, collaboration, and attention-to-detail skills.
- Bachelor’s degree in Computer Science, Software Engineering, Information Technology, or a related field, or equivalent experience.
- Preferred exposure to testing AI or LLM output with test datasets and scoring rubrics.
- Preferred familiarity with React applications, streaming user interfaces, contract testing, basic load testing, accessibility testing, GitHub Copilot, Playwright MCP, FHIR R4, and healthcare or other regulated environments handling PHI.
Benefits
- Comprehensive benefits, including health insurance benefits, for qualifying employees.
- Flexible work/life balance, autonomy, and flexibility to suit work to personal needs.
- Remote employees must have high-speed home internet above 10 Mbps; call center employees must also be able to connect directly to the home router.
- Hiring logistics include identity verification, background checks, in-person I-9 verification, possible drug screening, and possible onsite attendance for final interviews.
Tech Stack
Categories
About Evolent
Evolent is a public health care company that provides value-based care and specialty care management solutions to health plans and providers. Its platform combines clinical programs, software, and analytics to manage oncology, cardiology, musculoskeletal and other complex conditions, and supports payment models for Medicare Advantage, Medicaid and commercial plans. Founded in 2011 and headquartered in Arlington, Virginia, Evolent trades on the NYSE under the ticker EVH.