
Agile-RC-REGULATORY COMPLIANCE-GxP AI Model Consultant-Manager
Ernst and Young7 days ago
Hyderābād, IndiaStaff+
Responsibilities
- Lead AI and agentic AI consulting engagements from strategy through implementation and value realization.
- Design and oversee AI solutions using LLMs, AI agents, multi-agent systems, RAG, knowledge graphs, and AI orchestration frameworks.
- Support AI governance, model inventory, monitoring, validation, change management, traceability, and regulatory compliance in GxP environments.
- Create and execute risk-based validation, evaluation, adversarial, edge-case, functional, integration, regression, security-role, audit-trail, reconciliation, and user-acceptance testing strategies.
- Assess model accuracy, reliability, robustness, bias, subgroup performance, explainability, drift, hallucinations, agent failures, and residual risk.
- Define production monitoring for model performance, data and concept drift, anomalous outputs, overrides, human review, complaints, and incidents.
- Evaluate model, prompt, knowledge-base, infrastructure, and vendor changes through formal change control and impact assessment.
- Collaborate with data scientists and engineers on model improvements and risk mitigations.
- Lead client workshops to identify AI use cases, define target operating models, and develop AI roadmaps.
- Implement AI observability for tracing, evaluation logging, dashboards, alerting, failure analysis, and audit-ready evidence.
Requirements
- Bachelor's or master's degree in life sciences, engineering, or a related field.
- At least 8 years of experience in AI/ML, GenAI, software testing, validation, or quality engineering.
- Strong understanding of ML models, LLMs, GenAI workflows, agentic systems, and evaluation techniques.
- Hands-on experience with precision, recall, confusion matrices, ROC/AUC, supervised ML, and unsupervised ML models.
- Practical experience with LangChain, LangGraph, and Langfuse.
- Experience evaluating GenAI and LLM-based applications and agents.
- Experience creating user stories, test scripts, validation plans, acceptance criteria, AI solution prototypes, test harnesses, or demo environments.
- Ability to validate AI outputs, detect bias, assess model reliability, and investigate drift and performance degradation.
- Experience with AI observability, monitoring, tracing, evaluation logging, dashboards, or similar capabilities.
- Exposure to Azure, AWS, or GCP cloud ecosystems.
- Understanding of data integrity principles and electronic records/e-signatures compliance.
- Consulting, client-facing, stakeholder management, documentation, communication, and presentation experience.
- Familiarity with version control, prompt engineering fundamentals, and AI-assisted testing tools is preferred.
- Exposure to business development, thought leadership, process optimization, market analysis, and business transformation is preferred.
Benefits
- Support, coaching, and feedback from experienced colleagues.
- Opportunities to develop new skills and progress your career.
- Individual progression planning and opportunities for personal development.
- Education and coaching alongside practical experience.
- Freedom and flexibility to handle the role in a way that is right for you.
- Interdisciplinary work environment emphasizing high quality and knowledge exchange.
- Opportunities to work with EY Consulting practices globally and leading businesses across industries.
Tech Stack
Categories
Solutions Engineering
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.