AI Solutions QA Analyst
McDermott Will & Emery1 day ago
Boston, MA, USA +13 moreMid Level
Base Salary
$93k - $142k/yr
Responsibilities
- Own the full QA lifecycle for AI-powered solutions, including unit, integration, system, performance, scalability, functional, regression, and non-functional testing.
- Generate and evaluate test cases with AI-assisted tools, focusing on boundary conditions, edge cases, and AI output validation.
- Integrate automated test suites into Azure DevOps CI/CD pipelines for each solution.
- Define system-level test strategies with the Director of QA and engineering team.
- Coordinate with the security team to develop solution-specific security test cases.
- Evaluate reliability and consistency across varied inputs and real-world conditions.
- Maintain test documentation, defect tracking, and quality metrics for leadership reporting.
- Promote quality practices throughout the development workflow.
Requirements
- 4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle.
- Strong experience with unit, integration, system, and regression testing using both manual and automated methods.
- Hands-on experience integrating test suites into CI/CD pipelines; Azure DevOps experience is strongly preferred.
- Ability to design boundary and edge-case tests for complex, data-driven applications.
- Understanding of performance and scalability testing concepts; load-testing tool experience is a plus.
- Strong knowledge of defect tracking, test documentation, and quality metrics reporting.
- Active fluency with AI tools such as Claude, ChatGPT, or other leading AI platforms for testing workflows.
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or equivalent experience.
- Preferred experience testing AI-powered applications, prompt-driven systems, agentic workflows, or LLM-integrated tools.
- Preferred familiarity with AI-assisted test generation and code-generating platforms.
- Preferred exposure to security testing principles, regulated industries, and Azure DevOps pipeline configuration.
Benefits
- Remote-first team environment; the posting is also marked hybrid.
- Full-time position with eligibility for a discretionary bonus and comprehensive benefits package.
- Competitive total rewards package with performance-based bonus opportunities.
- Benefits supporting physical, emotional, mental, and financial health, with an emphasis on work-life balance.
Categories
About McDermott Will & Emery
McDermott Will & Emery is a global law firm that provides corporate, regulatory, litigation, tax, and intellectual property counsel to enterprises, financial institutions, and healthcare organizations. The partnership operates from 20+ offices across the U.S., Europe, and Asia, offering billable-hour and alternative-fee legal services. Founded in 1934 and headquartered in Chicago, it is known for strong healthcare and tax practices serving cross‑border and domestic matters.