1 day ago
Chicago, IL, USA +2 moreStaff+
Base Salary
$118k - $206k/yr
Responsibilities
- Lead the architecture, development, deployment, and operation of enterprise-grade AI and machine learning solutions.
- Design applications combining large language models, agentic workflows, retrieval, structured data, APIs, deterministic processing, and human expertise.
- Develop modular software components, APIs, prototypes, production services, reusable AI capabilities, evaluation frameworks, and platform components.
- Establish evaluation strategies using test sets, expert-reviewed outcomes, regression testing, quality measurements, and failure analysis.
- Design observability for intermediate outputs, decision traces, evaluation results, performance measures, and failure modes.
- Investigate grounding failures, hallucinations, retrieval quality, prompt behavior, model selection, orchestration, latency, accuracy, and cost.
- Implement security, privacy, auditability, monitoring, reliability, and production-readiness practices for AI-enabled applications.
- Mentor engineers, lead design and code reviews, strengthen engineering practices, and drive continuous improvement using production metrics and expert feedback.
Requirements
- A relevant degree is preferred.
- At least 7 years of relevant experience is required.
- Experience providing technical leadership for complex, production-grade software or AI systems is required.
- Demonstrated experience personally designing, building, deploying, and operating generative AI or machine learning applications in enterprise production environments is required.
- Strong Python and modern API/service development experience, including FastAPI or comparable frameworks, is required.
- Experience with large language models, prompt engineering, structured outputs, tool or function calling, retrieval-augmented generation, and agentic workflows is required.
- Experience establishing evaluation strategies for nondeterministic AI systems, including test datasets, regression evaluation, grounding, quality measurement, and failure analysis, is required.
- Understanding of the boundaries between probabilistic AI behavior and deterministic software, rules, retrieval, and data processing is required.
- Experience with cloud-native architecture, asynchronous processing, persistence, monitoring, and production observability is required.
- Experience addressing enterprise security, privacy, reliability, auditability, supportability, performance, and cost requirements is required.
- Experience with Azure, Azure AI Foundry, Azure AI Search, or comparable cloud AI and semantic-retrieval technologies is preferred.
- Experience with Databricks, vector databases, embeddings, reranking, semantic search, or enterprise knowledge-retrieval platforms is preferred.
- Experience developing AI solutions involving sensitive, regulated, or high-consequence data and decisions is preferred.
- Strong technical leadership, mentoring, communication, problem-solving, architecture, and cross-functional collaboration skills are required.
Benefits
- Comprehensive benefits plan.
- Incentive eligibility.
- The estimated salary range is $117,600.00 to $206,000.00, with geographic factors potentially affecting the range and individual compensation decisions tailored to circumstances.
Categories
About Vizient
Vizient provides healthcare performance improvement solutions to U.S. hospitals and health systems, combining a group purchasing organization with clinical, operational, and financial analytics and advisory services. Members access a national contract portfolio representing about $156 billion in annual purchasing volume and benchmarking data drawn from extensive provider networks. Headquartered in Irving, Texas, the privately held company serves more than two-thirds of U.S. acute care providers and acquired Kaufman Hall in 2024.