3 days ago
Remote, United States +2 moreStaff+
Base Salary
$195k - $325k/yr
Responsibilities
- Own the multi-year enterprise technical strategy and roadmap for the AI platform across model strategy, RAG architecture, connector ecosystems, and evaluation frameworks.
- Serve as the final technical escalation point for complex architecture and reliability problems spanning multiple AI teams and systems.
- Set, audit, and evolve architecture, security, and evaluation standards adopted by multiple Lead AI Engineers and their teams.
- Advise VP- and executive-level leadership on AI platform strategy, model risk, investment trade-offs, and AI adoption.
- Personally lead architecture and prototyping for high-ambiguity, high-risk AI initiatives.
- Mentor Lead and Senior AI Engineers through design reviews, technical coaching, and structured knowledge sharing.
- Shape enterprise AI governance covering model risk review, connector and tool approvals, and PHI handling in partnership with Legal, Compliance, and Privacy.
- Own enterprise strategy for foundation model providers and AI infrastructure vendors.
- Represent the company’s AI engineering capabilities with industry forums, partners, vendors, and senior technical recruiting.
- Influence AI platform direction and investment across the broader enterprise.
Requirements
- Bachelor’s degree or equivalent experience is required.
- Typically 12+ years of software engineering experience, including 6+ years focused on AI/ML, LLM, or NLP systems in production and 3+ years as a senior individual-contributor technical leader.
- Fewer years may be accepted with a relevant master’s degree or doctorate.
- Demonstrated technical leadership above the Lead AI Engineer level, including setting direction and standards across multiple teams.
- Proven experience establishing technical strategy adopted by multiple teams.
- Deep hands-on experience building production LLM applications at scale, including prompt engineering, RAG, agentic workflows, tool use, and evaluation harnesses.
- Experience with commercial large language model APIs such as Anthropic and OpenAI and tool-integration protocols such as Model Context Protocol.
- Strong software engineering fundamentals with Python and/or Java, event-driven architecture, microservices, and cloud-native design.
- Experience with vector and graph retrieval systems, embeddings, and knowledge-base architectures at production scale.
- Deep working knowledge of LLMOps/MLOps, including usage attribution, cost monitoring, abuse detection, and model evaluation pipelines.
- Ability to influence and align senior engineering and executive stakeholders without direct authority.
- Familiarity with regulated healthcare data environments and AI governance frameworks, including model risk review, connector approval tiers, and PHI handling.
- Preferred qualifications include an advanced degree in Computer Science, AI/ML, or a related technical field.
- Preferred qualifications include Principal, Staff, or Distinguished Engineer experience setting AI/ML strategy across multiple teams in healthcare IT or another regulated industry.
- Preferred qualifications include publications, patents, open-source contributions, or industry speaking on applied AI/LLM systems.
- Experience shaping enterprise AI governance policy and managing strategic relationships with AI infrastructure vendors and model providers is preferred.
- Exceptional written and verbal communication for executive, board-level, and external technical audiences is expected.
Benefits
- Competitive compensation package with base pay of $195,000–$325,000 and potential annual bonus or long-term incentive opportunities.
- Priority will be given to candidates residing in the Columbus, Ohio metropolitan area.
Tech Stack
Categories
About McKesson
McKesson is a public healthcare company that distributes pharmaceuticals and medical‑surgical supplies and provides pharmacy and provider technology and services. It sells to pharmacies, hospitals, health systems, and biopharma manufacturers through logistics, specialty and oncology support, pharmacy management, and healthcare IT/analytics offerings. Founded in 1833 and headquartered in Irving, Texas, it trades on the NYSE under the ticker MCK.