AI Solutions QA Analyst
McDermott Will & Emery1 day ago
Boston, MA, USA +12 moreMid Level
Base Salary
$93k - $142k/yr
Responsibilities
- Own unit, integration, system, regression, performance, scalability, and security testing across the full QA lifecycle for AI-powered solutions.
- Generate and evaluate test cases using AI-assisted tools, with emphasis on boundary conditions, edge cases, and AI output validation.
- Integrate automated test suites into Azure DevOps CI/CD pipelines in partnership with engineering.
- Define system-level functional, regression, and non-functional test strategies with the Director of QA.
- Translate security testing guidance into solution-specific test cases with the dedicated security team.
- Evaluate reliability across varied inputs and maintain test documentation, defect tracking, and quality metrics.
- Promote testing as an integrated part of the development workflow.
Requirements
- 4+ years of formal QA experience writing and executing test scripts across the full testing lifecycle.
- Strong experience with manual and automated unit, integration, system, and regression testing.
- Hands-on CI/CD pipeline integration experience; Azure DevOps experience is strongly preferred.
- Experience designing boundary and edge-case tests for complex, data-driven applications.
- Active use of AI tools and ability to direct AI platforms to generate, evaluate, and refine test cases.
- Understanding of performance and scalability testing concepts; load-testing tool experience is a plus.
- Strong knowledge of defect tracking, test documentation, and quality metrics reporting.
- Strong analytical thinking and ability to assess untested AI behavior systematically.
- Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent experience.
- Preferred qualifications include testing AI-powered applications, familiarity with AI-assisted test generation and code-generating platforms, security testing exposure, regulated-industry experience, and Azure DevOps pipeline configuration knowledge.
Benefits
- Remote-first team; the posting also identifies the role with a hybrid listing designation.
- Full-time employees are eligible for a comprehensive benefits package and discretionary performance-based bonus.
- Benefits support physical, emotional, mental, and financial health, with an emphasis on work-life balance.
- Competitive total rewards package and career development opportunities.
- Typical indoor office environment with reasonable accommodations available for individuals with disabilities.
Categories
About McDermott Will & Emery
McDermott Will & Emery is a global law firm that provides corporate, regulatory, litigation, tax, and intellectual property counsel to enterprises, financial institutions, and healthcare organizations. The partnership operates from 20+ offices across the U.S., Europe, and Asia, offering billable-hour and alternative-fee legal services. Founded in 1934 and headquartered in Chicago, it is known for strong healthcare and tax practices serving cross‑border and domestic matters.