
RC-REGULATORY COMPLIANCE-GxP AI Model Consultant-Manager
Ernst and Young28 days ago
Noida, IndiaStaff+
Responsibilities
- Lead AI and agentic AI engagements from strategy through implementation and value realization.
- Design and oversee LLM, AI-agent, multi-agent, RAG, knowledge-graph, and AI-orchestration solutions.
- Lead client workshops to identify use cases, define operating models, and create AI roadmaps.
- Manage cross-functional teams of AI engineers, data scientists, architects, and business consultants.
- Establish AI governance, observability, risk management, model monitoring, and responsible AI practices.
- Perform model integration, evaluation, validation, testing, deployment, and post-deployment monitoring.
- Evaluate models using precision, recall, accuracy, F1-score, ROC/AUC, and confusion matrices.
- Assess model behavior for bias, drift, instability, edge cases, and failure scenarios.
- Design testing strategies for AI agents and multi-agent workflows, including orchestration, tool invocation, and output validation.
- Configure and develop applications, workflows, data models, integrations, reports, prototypes, test harnesses, and demo environments.
- Use LangChain, LangGraph, and Langfuse for agent workflows, observability, traceability, and evaluation logging.
- Translate business requirements into functional and technical solution designs and provide risk mitigations.
- Support proposals, solutioning, client presentations, business development, and thought leadership.
Requirements
- Bachelor's or master's degree in life sciences, engineering, or a related field.
- 8+ years of experience in AI/ML, GenAI, software testing, validation, or quality engineering.
- Strong understanding of ML models, LLMs, GenAI workflows, agentic systems, and evaluation techniques.
- Hands-on experience with LangChain, LangGraph, Langfuse, GenAI or LLM applications, and AI agents.
- Experience with supervised and unsupervised learning, classification, regression, clustering, anomaly detection, and model evaluation.
- Experience creating user stories, test scripts, validation plans, acceptance criteria, or AI solution prototypes.
- Hands-on experience with APIs, scripting/programming, software development lifecycle activities, and AI-assisted testing tools.
- Experience evaluating AI outputs, detecting bias, assessing reliability, and designing test cases.
- Exposure to Azure, AWS, or GCP cloud ecosystems.
- Understanding of data integrity principles and electronic records/e-signatures compliance.
- Consulting, client-facing, stakeholder management, documentation, communication, and presentation experience preferred.
- Familiarity with version control and prompt engineering fundamentals preferred.
- Experience with business development, client engagement, process optimization, or technology transformation is advantageous.
Benefits
- Support, coaching, and feedback from experienced colleagues.
- Opportunities to develop new skills and progress your career.
- Individual progression planning, education, coaching, and practical experience.
- Freedom and flexibility to handle the role in a way that is right for you.
- Work in an interdisciplinary, global consulting environment with challenging client projects.