1 day ago
Chicago, IL, USA or Irving, TX, USASenior
Base Salary
$102k - $179k/yr
Responsibilities
- Design and implement production AI-enabled application services and workflow components.
- Build modular large language model and agentic capabilities with defined responsibilities, inputs, outputs, and evaluation criteria.
- Develop retrieval and grounding solutions using structured data, semantic search, vector retrieval, and enterprise knowledge sources.
- Build APIs, services, orchestration components, and asynchronous processing capabilities for production AI workloads.
- Develop automated evaluation and regression testing for large language model and AI behavior.
- Instrument applications to trace inputs, model interactions, decisions, errors, latency, and operational behavior.
- Investigate AI failure modes and improve prompts, retrieval, workflow design, model selection, and application logic.
- Implement controls that validate, constrain, and monitor model outputs within enterprise applications.
- Participate in architecture reviews, technical design sessions, code reviews, and continuous improvement activities.
- Support deployed AI applications through monitoring, troubleshooting, performance optimization, and production issue resolution.
Requirements
- At least 5 years of relevant experience.
- Strong experience developing production applications using Python.
- Hands-on experience building, deploying, and supporting generative AI or machine learning applications in production environments.
- Experience integrating commercial or open-source large language models through APIs or managed AI platforms.
- Experience with prompt engineering, structured model outputs, tool or function calling, retrieval-augmented generation, or agentic workflows.
- Experience building data-driven APIs and distributed application services using FastAPI or comparable frameworks.
- Experience developing automated tests and evaluation methods for nondeterministic AI behavior.
- Experience with embeddings, semantic search, vector retrieval, reranking, or comparable knowledge-retrieval techniques.
- Experience with cloud-native development, CI/CD pipelines, containerized services, and production deployment.
- Experience debugging complex issues across application code, enterprise data, AI models, retrieval systems, and distributed workflows.
- A relevant degree is preferred.
- Experience with Microsoft Azure, Azure AI Foundry, Azure AI Search, Databricks, or Azure Service Bus is preferred.
- Experience with AI evaluation, tracing, observability tooling, SQL, NoSQL databases, or agent-orchestration frameworks is preferred.
- Experience developing applications involving sensitive, regulated, or high-consequence enterprise data is preferred.
Benefits
- Comprehensive benefits plan.
- The position is incentive eligible.
- The current salary range is $102,400.00 to $179,000.00, with geographic factors potentially affecting the range.
- The posting describes an inclusive environment with opportunities for personal and professional development.
Categories
About Vizient
Vizient provides healthcare performance improvement solutions to U.S. hospitals and health systems, combining a group purchasing organization with clinical, operational, and financial analytics and advisory services. Members access a national contract portfolio representing about $156 billion in annual purchasing volume and benchmarking data drawn from extensive provider networks. Headquartered in Irving, Texas, the privately held company serves more than two-thirds of U.S. acute care providers and acquired Kaufman Hall in 2024.