Principal AI/ML Engineer - Post Deployment Governance
Mayo Clinic1 day ago
Rochester, MN, USAStaff+
Responsibilities
- Define risk-proportionate enterprise requirements and standards for AI post-deployment monitoring, reporting, measurement, PDM, and PDRS governance.
- Establish standards for signals, metrics, formulas, baselines, targets, thresholds, uncertainty, evidence confidence, outcomes, subgroup interpretation, and monitoring readiness.
- Review governance assessments and evidence for policy alignment, sufficiency, traceability, methodological adequacy, and decision readiness.
- Assess metric validity, source fitness, threshold logic, analyses, limitations, conclusions, observability, logging, telemetry, workflow signals, version context, and change detection.
- Own complex and precedent-setting questions involving monitoring, thresholds, insufficient evidence, vendor limitations, significant change, revalidation, lifecycle action, PDRS, and escalation.
- Recommend corrections, alternate methods, interim controls, additional evidence, action plans, re-review, retesting, or revalidation.
- Lead PDRS templates and rubrics, evidence-confidence and escalation methods, metric libraries, executive presentation standards, and governance acceptance criteria.
- Convert recurring governance gaps into policies, playbooks, standard findings, rubrics, examples, training, calibration, and Product Lead enablement.
- Define requirements for TRex workflows, evidence objects, traceability, dashboards, portfolio visibility, and reusable governance capabilities.
- Coordinate with product teams, vendors, platforms, legal, committees, and enterprise groups on methods, tooling, specifications, and ownership.
- Communicate complex-case findings, limitations, confidence, required actions, and escalation triggers to technical, business, and clinical audiences.
- Mentor and calibrate engineers, analysts, and Product Leads and provide technical leadership to junior engineers.
- Support audit sampling, quality assurance, enterprise learning, and continuous improvement while preserving the review-and-consultation boundary.
Requirements
- Master's degree in engineering, computer science, mathematics, health science, or a related field with 7 years of relevant experience, or a bachelor's degree with 9 years of relevant experience.
- At least 7 years of experience applying AI and machine learning in production healthcare environments or similar regulated or technology-focused industries.
- Demonstrated leadership managing complex projects and navigating intricate requirements to successful outcomes.
- Experience fostering collaboration across diverse teams and communicating complex technical concepts to non-technical stakeholders.
- Expertise in cloud infrastructure environments, software development tools, AI/ML techniques and frameworks, data engineering, data science, AI engineering, and MLOps practices.
- Experience working with large, complex, heterogeneous data sets, preferably in healthcare.
- In-depth knowledge of clinical workflows, electronic health records, medical terminologies, healthcare regulations, industry standards, and compliance frameworks.
- Experience mentoring and training less-experienced team members and leading technical or quantitative teams in regulated environments.
- Preferred doctorate or Ph.D.
- Preferred experience with healthcare informatics standards, common data models, standards organizations, and development and deployment standards.
- Experience creating risk management files and verification and validation strategies for digital health technology products.
- Expertise in user-centered design, human factors engineering, usability testing, and evaluation across AI product development.
- Hands-on leadership using the TRex assessment application to govern AI tools deployed in EPIC, ANIMATE, and comparable clinical environments.
- Strong problem-solving, critical-thinking, communication, collaboration, stakeholder-management, and time-management skills.
Categories
About Mayo Clinic
Mayo Clinic is a nonprofit academic medical center and health system providing hospital and specialty care, research, and medical education to patients globally. It operates major campuses in Rochester, Minnesota (headquarters), Phoenix/Scottsdale, Arizona, and Jacksonville, Florida, plus a regional health system across the Midwest. Revenue comes primarily from clinical services, complemented by research grants and education programs; specialties include heart care, cancer, transplantation, and neurosciences.