Copilot Engineer
Ernst and Young1 day ago
Kolkāta, IndiaMid Level / Senior
Responsibilities
- Design, refine, and optimize prompts for Microsoft Copilot and Copilot Studio across audit, controls, risk, and reporting use cases.
- Engineer multi-turn conversational flows, system prompts, grounding instructions, response constraints, guardrails, and RAG patterns.
- Build and configure Copilot Studio agents with topics, triggers, entities, actions, plugins, and orchestration logic.
- Integrate Copilot Studio with enterprise data sources, workflows, APIs, and Assurance tools.
- Define and execute prompt validation, negative testing, edge-case handling, and output evaluation strategies.
- Support AI governance, risk management, compliance, certification, QRM reviews, and engagement-readiness assessments.
- Document prompt logic, limitations, assumptions, and usage guidance for audit and risk reviews.
- Create user guidance, prompt playbooks, best-practice documentation, and training for Assurance users.
- Research Microsoft Copilot, Copilot Studio, Azure OpenAI, and emerging prompt engineering techniques.
- Contribute to reusable prompt libraries, agent templates, and design standards.
Requirements
- 4–7 years of experience in AI-enabled product, automation, or digital roles.
- Hands-on experience with prompt engineering for LLM-based systems.
- Practical experience building solutions with Microsoft Copilot and/or Copilot Studio, Python, and LangGraph.
- Strong understanding of LLM behavior, limitations, risks, and evaluation techniques.
- Ability to translate complex business or regulatory requirements into structured AI interactions.
- Experience working in Agile delivery models with cross-functional global teams.
- Excellent communication skills and the ability to explain AI behavior to non-technical stakeholders.
- Familiarity with Assurance, Audit, Risk, or regulatory workflows is preferred.
- Experience with RAG patterns, vector search, and enterprise data grounding is preferred.
- Exposure to AI governance, risk management, or model validation frameworks is preferred.
- Knowledge of Azure services and API-based integrations is preferred.
- Ability to create conversation flows, prompt maps, and AI interaction diagrams is preferred.
Categories