Vizient

Lead Architect, AI Quality and Reliability Engineering

Vizient
Apply
2 days ago
Chicago, IL, USA or Edina, MN, USAStaff+

Base Salary

$135k - $237k/yr

Responsibilities

  • Lead quality engineering strategy, automation execution, validation standards, and measurable quality goals across the product.
  • Design and develop scalable automated testing frameworks for data pipelines, APIs, business logic, analytics, AI capabilities, and user-facing applications.
  • Establish data validation and reconciliation practices for healthcare data and calculated metrics.
  • Develop automated testing for AI-enabled applications, including LLM evaluation, output accuracy, regression testing, and agentic workflow validation.
  • Build and maintain regression suites, test datasets, CI/CD quality gates, and monitoring capabilities.
  • Drive integration, functional, performance, reliability, and end-to-end product validation.
  • Partner with Product, Engineering, and domain experts on acceptance criteria, defect investigation, and production readiness.
  • Mentor engineers and drive continuous improvement in automation, testing practices, and product reliability.
  • Develop reusable testing tools using Palantir Foundry, AIP, and AI-assisted development capabilities.
  • Evaluate emerging AI testing tools and methodologies.

Requirements

  • Experience leading quality engineering strategy and execution across complex data and application workflows.
  • Experience developing scalable automated testing frameworks and regression suites.
  • Ability to validate data accuracy, completeness, consistency, and integrity in healthcare data and metrics.
  • Experience testing AI-enabled applications, including LLM evaluation, output accuracy, regression, and agentic workflows.
  • Experience with integration, functional, performance, reliability, and end-to-end testing.
  • Ability to partner with product, engineering, and domain teams and mentor engineers.
  • Experience with Palantir Foundry, AIP, or modern AI-assisted development capabilities is preferred.

Benefits

  • Comprehensive benefits plan.
  • Incentive eligibility.
  • Salary range of $135,200.00 to $236,600.00, adjusted based on geographic factors and individual circumstances.

Categories

Vizient

About Vizient

5,001-10,000 employees

Vizient provides healthcare performance improvement solutions to U.S. hospitals and health systems, combining a group purchasing organization with clinical, operational, and financial analytics and advisory services. Members access a national contract portfolio representing about $156 billion in annual purchasing volume and benchmarking data drawn from extensive provider networks. Headquartered in Irving, Texas, the privately held company serves more than two-thirds of U.S. acute care providers and acquired Kaufman Hall in 2024.

Contact me