Lead AI Engineer
CoverMyMeds3 days ago
Columbus, OH, USA +2 moreStaff+
Base Salary
$155k - $259k/yr
Responsibilities
- Define the architecture and roadmap for LLM and agentic systems, including model routing, integrations, RAG pipelines, and prompt and evaluation frameworks.
- Lead architecture reviews and ensure AI designs satisfy security, privacy, data-provenance, governance, and PHI-handling requirements.
- Design shared AI platform capabilities such as knowledge retrieval, citation and traceability, and permission-aware data access.
- Architect and build high-complexity components for priority AI delivery initiatives.
- Set coding, architecture, and evaluation standards while mentoring Senior and Associate AI Engineers through design reviews and pairing.
- Establish LLMOps and responsible AI practices covering usage attribution, cost monitoring, abuse detection, model evaluation, observability, and rollback.
- Partner with engineering, product, platform, Legal, Compliance, and Privacy stakeholders on AI architecture decisions.
- Evaluate foundation-model providers and AI tooling vendors and make build-versus-buy and model-selection recommendations.
- Represent AI platform architecture in cross-company forums and influence enterprise-wide platform direction.
Requirements
- Bachelor's degree or equivalent experience; typically 8+ years of software engineering experience, including 3+ years focused on AI/ML, LLM, or NLP systems in production.
- Demonstrated technical leadership above the Senior AI Engineer level, including architecture ownership for a team or platform area.
- Hands-on experience building production LLM applications using prompt engineering, RAG or GraphRAG, agentic workflows, tool use, and evaluation harnesses.
- Experience with commercial LLM APIs such as Anthropic and OpenAI and tool-integration protocols such as Model Context Protocol.
- Strong software engineering fundamentals in Python and/or Java, REST APIs, event-driven architecture, microservices, and cloud-native design.
- Experience with vector and graph retrieval systems, embeddings, and production-scale knowledge-base architectures.
- Working knowledge of LLMOps or MLOps, including usage attribution, cost monitoring, abuse detection, and model evaluation pipelines.
- Ability to establish architectural standards and mentor engineers through design reviews and pairing.
- Familiarity with regulated or healthcare data environments and AI governance frameworks is preferred.
- An advanced degree in Computer Science, AI/ML, or a related technical field is preferred.
- Experience leading AI/ML platform or applied-AI teams in healthcare IT or another highly regulated industry is preferred.
- Experience modernizing legacy systems toward AI-embedded workflows is preferred.
- Experience with Confluence and Jira-based engineering governance and enterprise architecture review boards is preferred.
- Experience managing relationships with AI tooling vendors and model providers, plus clear communication for technical and executive audiences.
Benefits
- Competitive compensation package with base pay and potential annual bonus or long-term incentive opportunities; benefits information is provided through McKesson's Total Rewards materials.
- Priority consideration is given to candidates residing in the Columbus, Ohio metropolitan area.
- McKesson is unable to provide sponsorship for this role presently or in the future.
- Reasonable accommodations are available for applicants with disabilities.
Tech Stack
Categories
About CoverMyMeds
CoverMyMeds builds software that streamlines prior authorization and medication access for prescribers, pharmacies, health plans, and pharmaceutical manufacturers. Its platforms integrate with EHRs and pharmacy systems to automate approvals and support patient adherence, operating on a B2B model across U.S. healthcare stakeholders. Founded in 2008 and headquartered in Columbus, OH, the company is part of McKesson Corporation.