Ernst and Young

Agile-RC-REGULATORY COMPLIANCE-GxP AI Model Consultant-Manager

Ernst and Young
Apply
7 days ago
Hyderābād, IndiaStaff+

Responsibilities

  • Lead AI and agentic AI consulting engagements from strategy through implementation and value realization.
  • Design and oversee AI solutions using LLMs, AI agents, multi-agent systems, RAG, knowledge graphs, and AI orchestration frameworks.
  • Support AI governance, model inventory, monitoring, validation, change management, traceability, and regulatory compliance in GxP environments.
  • Create and execute risk-based validation, evaluation, adversarial, edge-case, functional, integration, regression, security-role, audit-trail, reconciliation, and user-acceptance testing strategies.
  • Assess model accuracy, reliability, robustness, bias, subgroup performance, explainability, drift, hallucinations, agent failures, and residual risk.
  • Define production monitoring for model performance, data and concept drift, anomalous outputs, overrides, human review, complaints, and incidents.
  • Evaluate model, prompt, knowledge-base, infrastructure, and vendor changes through formal change control and impact assessment.
  • Collaborate with data scientists and engineers on model improvements and risk mitigations.
  • Lead client workshops to identify AI use cases, define target operating models, and develop AI roadmaps.
  • Implement AI observability for tracing, evaluation logging, dashboards, alerting, failure analysis, and audit-ready evidence.

Requirements

  • Bachelor's or master's degree in life sciences, engineering, or a related field.
  • At least 8 years of experience in AI/ML, GenAI, software testing, validation, or quality engineering.
  • Strong understanding of ML models, LLMs, GenAI workflows, agentic systems, and evaluation techniques.
  • Hands-on experience with precision, recall, confusion matrices, ROC/AUC, supervised ML, and unsupervised ML models.
  • Practical experience with LangChain, LangGraph, and Langfuse.
  • Experience evaluating GenAI and LLM-based applications and agents.
  • Experience creating user stories, test scripts, validation plans, acceptance criteria, AI solution prototypes, test harnesses, or demo environments.
  • Ability to validate AI outputs, detect bias, assess model reliability, and investigate drift and performance degradation.
  • Experience with AI observability, monitoring, tracing, evaluation logging, dashboards, or similar capabilities.
  • Exposure to Azure, AWS, or GCP cloud ecosystems.
  • Understanding of data integrity principles and electronic records/e-signatures compliance.
  • Consulting, client-facing, stakeholder management, documentation, communication, and presentation experience.
  • Familiarity with version control, prompt engineering fundamentals, and AI-assisted testing tools is preferred.
  • Exposure to business development, thought leadership, process optimization, market analysis, and business transformation is preferred.

Benefits

  • Support, coaching, and feedback from experienced colleagues.
  • Opportunities to develop new skills and progress your career.
  • Individual progression planning and opportunities for personal development.
  • Education and coaching alongside practical experience.
  • Freedom and flexibility to handle the role in a way that is right for you.
  • Interdisciplinary work environment emphasizing high quality and knowledge exchange.
  • Opportunities to work with EY Consulting practices globally and leading businesses across industries.

Categories

Solutions Engineering
Ernst and Young

About Ernst and Young

10,000+ employees

Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.

Contact me