Vizient

Senior AI Quality & Reliability Engineer

Vizient
Apply
3 days ago
Chicago, IL, USA +2 moreSenior

Base Salary

$102k - $179k/yr

Responsibilities

  • Design, develop, and execute AI Quality Engineering strategies for AI-powered applications, LLM solutions, intelligent automation, agentic systems, and enterprise AI platforms.
  • Build scalable AI-native testing practices, validation processes, runtime quality controls, reusable testing accelerators, and automated testing frameworks.
  • Lead functional, prompt, workflow, regression, release, runtime quality assurance, and production reliability testing.
  • Develop AI evaluation frameworks, validation datasets, quality scoring methodologies, and automated testing workflows.
  • Support runtime reliability through observability, telemetry, distributed tracing, monitoring, drift detection, incident response, and operational quality assurance.
  • Validate healthcare workflows, payer operations, clinical processes, and AI-enabled business workflows using responsible AI and human-in-the-loop practices.
  • Coordinate testing across Agile delivery teams, including test execution, defect management, issue tracking, release readiness, risk identification, and production support.
  • Mentor Quality Engineers and provide technical guidance on AI-enabled testing modernization and Quality Engineering practices.
  • Research and recommend emerging AI Quality Engineering, testing automation, observability, and runtime assurance technologies.

Requirements

  • Bachelor's degree in Computer Science and 5 or more years of experience in Quality Engineering, Quality Assurance, software testing, enterprise application delivery, technology operations, or related technology functions.
  • 2 or more years of experience providing technical leadership for testing initiatives, automation programs, or enterprise technology delivery projects.
  • Experience supporting Quality Engineering or Quality Assurance across enterprise platforms, APIs, healthcare applications, operational workflows, or integrated business systems.
  • Strong knowledge of software development life cycle, Agile methodologies, test automation frameworks, defect management, release validation, and production support processes.
  • Experience validating AI-powered applications, intelligent automation, machine learning, LLMs, or AI-enabled business workflows is preferred.
  • Experience with AI Quality Engineering, AI-assisted testing, runtime observability, monitoring, telemetry, or reliability engineering is preferred.
  • Experience in healthcare technology, payer operations, clinical workflows, or regulated industries supporting AI governance and responsible AI deployment is preferred.
  • An advanced degree in Computer Science, Engineering, or a related field is highly preferred.
  • Strong analytical, problem-solving, organizational, communication, collaboration, and leadership skills, with the ability to manage multiple priorities in an enterprise environment.

Benefits

  • Comprehensive benefits plan.
  • The position is incentive eligible.
  • Geographic factors may adjust the estimated salary range, and hires typically fall below the top of the range.

Categories

Vizient

About Vizient

5,001-10,000 employees

Vizient provides healthcare performance improvement solutions to U.S. hospitals and health systems, combining a group purchasing organization with clinical, operational, and financial analytics and advisory services. Members access a national contract portfolio representing about $156 billion in annual purchasing volume and benchmarking data drawn from extensive provider networks. Headquartered in Irving, Texas, the privately held company serves more than two-thirds of U.S. acute care providers and acquired Kaufman Hall in 2024.

Contact me