Ernst and Young

RC-REGULATORY COMPLIANCE-GxP AI Model Consultant-Manager

Ernst and Young
Apply
28 days ago
Noida, IndiaStaff+

Responsibilities

  • Lead AI and agentic AI engagements from strategy through implementation and value realization.
  • Design and oversee LLM, AI-agent, multi-agent, RAG, knowledge-graph, and AI-orchestration solutions.
  • Lead client workshops to identify use cases, define operating models, and create AI roadmaps.
  • Manage cross-functional teams of AI engineers, data scientists, architects, and business consultants.
  • Establish AI governance, observability, risk management, model monitoring, and responsible AI practices.
  • Perform model integration, evaluation, validation, testing, deployment, and post-deployment monitoring.
  • Evaluate models using precision, recall, accuracy, F1-score, ROC/AUC, and confusion matrices.
  • Assess model behavior for bias, drift, instability, edge cases, and failure scenarios.
  • Design testing strategies for AI agents and multi-agent workflows, including orchestration, tool invocation, and output validation.
  • Configure and develop applications, workflows, data models, integrations, reports, prototypes, test harnesses, and demo environments.
  • Use LangChain, LangGraph, and Langfuse for agent workflows, observability, traceability, and evaluation logging.
  • Translate business requirements into functional and technical solution designs and provide risk mitigations.
  • Support proposals, solutioning, client presentations, business development, and thought leadership.

Requirements

  • Bachelor's or master's degree in life sciences, engineering, or a related field.
  • 8+ years of experience in AI/ML, GenAI, software testing, validation, or quality engineering.
  • Strong understanding of ML models, LLMs, GenAI workflows, agentic systems, and evaluation techniques.
  • Hands-on experience with LangChain, LangGraph, Langfuse, GenAI or LLM applications, and AI agents.
  • Experience with supervised and unsupervised learning, classification, regression, clustering, anomaly detection, and model evaluation.
  • Experience creating user stories, test scripts, validation plans, acceptance criteria, or AI solution prototypes.
  • Hands-on experience with APIs, scripting/programming, software development lifecycle activities, and AI-assisted testing tools.
  • Experience evaluating AI outputs, detecting bias, assessing reliability, and designing test cases.
  • Exposure to Azure, AWS, or GCP cloud ecosystems.
  • Understanding of data integrity principles and electronic records/e-signatures compliance.
  • Consulting, client-facing, stakeholder management, documentation, communication, and presentation experience preferred.
  • Familiarity with version control and prompt engineering fundamentals preferred.
  • Experience with business development, client engagement, process optimization, or technology transformation is advantageous.

Benefits

  • Support, coaching, and feedback from experienced colleagues.
  • Opportunities to develop new skills and progress your career.
  • Individual progression planning, education, coaching, and practical experience.
  • Freedom and flexibility to handle the role in a way that is right for you.
  • Work in an interdisciplinary, global consulting environment with challenging client projects.
Ernst and Young

About Ernst and Young

10,000+ employees
Contact me