Principal AI Engineer
CoverMyMeds3 days ago
Remote, United States +2 moreStaff+
Base Salary
$195k - $325k/yr
Responsibilities
- Own the enterprise multi-year technical strategy and roadmap for AI platforms, including model strategy, RAG architecture, connector ecosystems, and evaluation frameworks.
- Serve as the final technical escalation point for complex architecture, reliability, and platform problems spanning multiple teams and systems.
- Set, audit, and evolve architecture, security, and evaluation standards adopted by multiple AI engineering teams.
- Advise VP- and executive-level leaders on AI strategy, model risk, investment trade-offs, and platform direction.
- Lead architecture and prototyping for high-ambiguity, high-risk AI initiatives that lack existing patterns or solutions.
- Mentor Lead and Senior AI Engineers through design reviews, technical coaching, and knowledge-sharing.
- Shape enterprise AI governance policies covering model risk review, connector and tool approvals, and PHI handling.
- Own enterprise strategy and evaluation for foundation model providers and AI infrastructure vendors.
- Represent McKesson’s AI engineering capabilities in industry forums, partner and vendor relationships, and senior technical recruiting.
Requirements
- Bachelor’s degree or equivalent experience; fewer years may be accepted with a relevant master’s or doctorate.
- Typically 12+ years of software engineering experience, including 6+ years focused on production AI/ML, LLM, or NLP systems and 3+ years as a senior individual-contributor technical leader.
- Demonstrated technical leadership above the Lead AI Engineer level, including setting strategy and standards adopted across multiple teams.
- Hands-on experience building production LLM applications at scale using prompt engineering, RAG, agentic workflows, tool use, and evaluation harnesses.
- Experience with commercial LLM APIs such as Anthropic and OpenAI and tool-integration protocols such as Model Context Protocol.
- Strong software engineering fundamentals with Python and/or Java, event-driven architecture, microservices, and cloud-native design; Azure is preferred, with AWS or GCP acceptable.
- Experience with vector and graph retrieval systems, embeddings, and production knowledge-base architectures across multiple products.
- Deep working knowledge of LLMOps/MLOps, usage attribution, cost monitoring, abuse detection, and model evaluation pipelines.
- Ability to influence senior engineering and executive stakeholders without direct authority.
- Experience with regulated or healthcare data environments and AI governance frameworks.
- Advanced degree, prior Principal/Staff/Distinguished Engineer experience, publications, patents, open-source contributions, industry speaking, and enterprise AI governance experience are preferred.
Benefits
- Base pay range is $195,000–$325,000, with potential annual bonus or long-term incentive opportunities; compensation figures are excluded from benefit details.
- Priority is given to candidates residing in the Columbus, Ohio metropolitan area.
- The role does not provide sponsorship presently or in the future.
Tech Stack
Categories
About CoverMyMeds
CoverMyMeds builds software that streamlines prior authorization and medication access for prescribers, pharmacies, health plans, and pharmaceutical manufacturers. Its platforms integrate with EHRs and pharmacy systems to automate approvals and support patient adherence, operating on a B2B model across U.S. healthcare stakeholders. Founded in 2008 and headquartered in Columbus, OH, the company is part of McKesson Corporation.