3 days ago
Remote, United States +2 moreStaff+
Base Salary
$155k - $259k/yr
Responsibilities
- Define architecture and technical roadmaps for LLM, agentic, retrieval, connector, prompt, and evaluation systems.
- Lead architecture reviews and ensure AI designs satisfy security, privacy, data-provenance, governance, and PHI requirements.
- Own the technical design of shared AI platform capabilities, including knowledge retrieval, citation and traceability, and permission-aware data access.
- Personally architect and build high-complexity production components for priority AI delivery initiatives.
- Set coding, architecture, and evaluation standards while mentoring Senior and Associate AI Engineers through design reviews and pairing.
- Establish secure, observable, and cost-attributed LLM operations, including usage attribution, abuse monitoring, evaluation, and rollback strategies.
- Partner with engineering, product, platform, Legal, Compliance, and Privacy stakeholders on architecture and delivery decisions.
- Evaluate foundation-model providers and AI tooling vendors and make build-versus-buy and model-selection recommendations.
- Represent AI architecture in enterprise forums and influence organization-wide platform direction.
Requirements
- Bachelor’s degree or equivalent experience; fewer years may be accepted with a relevant master’s or doctorate.
- Typically 8+ years of software engineering experience, including 3+ years focused on AI/ML, LLM, or NLP systems in production.
- Demonstrated technical leadership above the Senior AI Engineer level, such as owning architecture for a team or platform area.
- Hands-on production experience with prompt engineering, RAG or GraphRAG, agentic workflows, tool use, and evaluation harnesses.
- Experience with commercial LLM APIs such as Anthropic or OpenAI and tool-integration protocols such as Model Context Protocol.
- Strong software engineering fundamentals using Python and/or Java, event-driven architecture, microservices, and cloud-native design.
- Experience with vector or graph retrieval systems, embeddings, and production-scale knowledge-base architectures.
- Working knowledge of LLMOps or MLOps, including usage attribution, cost monitoring, abuse detection, and model-evaluation pipelines.
- Ability to establish architectural standards and mentor engineers through reviews and pairing.
- Advanced degree in Computer Science, AI/ML, or a related technical field is preferred.
- Experience leading AI/ML platform or applied-AI teams in healthcare IT or another regulated industry is preferred.
- Experience with legacy-system modernization, AI-embedded workflows, Confluence, Jira, and enterprise architecture review boards is preferred.
- Experience managing relationships with AI tooling vendors and model providers, plus clear communication with technical and executive audiences.
Benefits
- Competitive base pay range of $155,300–$258,800, with potential annual bonus or long-term incentive opportunities.
- Priority is given to candidates residing in the Columbus, Ohio metropolitan area.
- McKesson provides equal employment opportunities and reasonable accommodation support for applicants with disabilities.
Tech Stack
Categories
About McKesson
McKesson is a public healthcare company that distributes pharmaceuticals and medical‑surgical supplies and provides pharmacy and provider technology and services. It sells to pharmacies, hospitals, health systems, and biopharma manufacturers through logistics, specialty and oncology support, pharmacy management, and healthcare IT/analytics offerings. Founded in 1833 and headquartered in Irving, Texas, it trades on the NYSE under the ticker MCK.