1 day ago
Chicago, IL, USA +2 moreSenior
Base Salary
$102k - $179k/yr
Responsibilities
- Design and execute quality engineering strategies for AI applications, agentic AI systems, UIs, APIs, LLM workflows, and enterprise platforms.
- Develop scalable test automation frameworks, reusable testing accelerators, validation processes, and automated workflows.
- Implement functional, prompt, workflow, integration, regression, and human-in-the-loop testing with validation datasets and quality evaluation methods.
- Support runtime quality through telemetry, distributed tracing, observability, monitoring, drift detection, incident analysis, and production validation.
- Coordinate test execution, defect management, release validation, risk identification, and production support activities.
- Evaluate testing, automation, observability, and AI quality engineering tools and technologies.
- Mentor quality engineers and analysts and communicate quality risks, findings, dependencies, and recommendations.
Requirements
- Experience designing quality engineering strategies for AI-powered applications, agentic AI systems, user interfaces, APIs, LLM-enabled workflows, and integrated enterprise platforms.
- Ability to build scalable test automation frameworks and reusable testing accelerators.
- Knowledge of AI validation, prompt testing, workflow testing, integration testing, regression testing, human-in-the-loop testing, validation datasets, and quality evaluation.
- Experience with runtime quality, observability, monitoring, drift detection, incident analysis, and production validation.
- Ability to collaborate with engineering, AIOps, LLMOps, security, governance, data, clinical, and operational stakeholders.
- Technical mentoring, defect management, release validation, risk assessment, and communication skills.
Benefits
- Comprehensive benefits plan.
- Incentive eligible.
Categories
About Vizient
Vizient provides healthcare performance improvement solutions to U.S. hospitals and health systems, combining a group purchasing organization with clinical, operational, and financial analytics and advisory services. Members access a national contract portfolio representing about $156 billion in annual purchasing volume and benchmarking data drawn from extensive provider networks. Headquartered in Irving, Texas, the privately held company serves more than two-thirds of U.S. acute care providers and acquired Kaufman Hall in 2024.