
Copilot Engineer
Ernst and Young23 hours ago
Kolkāta, IndiaMid Level / Senior
Responsibilities
- Design, refine, and optimize prompts, system instructions, grounding guidance, response constraints, and conversational workflows for Microsoft Copilot and Copilot Studio.
- Build and configure Copilot Studio agents, including topics, triggers, entities, actions, plugins, routing, and orchestration logic.
- Integrate Copilot Studio with enterprise data sources, workflows, APIs, and assurance tools according to security and governance standards.
- Define and execute AI testing strategies covering prompt validation, negative testing, edge cases, output evaluation, explainability, traceability, and human-in-the-loop controls.
- Support AI certification, QRM reviews, engagement-readiness assessments, documentation, user guidance, training, and adoption of Copilot solutions.
- Research emerging Copilot and generative AI capabilities and contribute reusable prompt libraries, agent templates, and design standards.
Requirements
- 4–7 years of experience in AI-enabled product, automation, or digital roles.
- Hands-on experience with prompt engineering for LLM-based systems.
- Practical experience building solutions with Microsoft Copilot and/or Copilot Studio, Python, and LangGraph.
- Strong understanding of LLM behavior, limitations, risks, and evaluation techniques.
- Ability to translate complex business or regulatory requirements into structured AI interactions.
- Experience working in Agile delivery models with cross-functional global teams and communicating AI behavior to nontechnical stakeholders.
- Preferred qualifications include familiarity with Assurance, Audit, Risk, or Regulatory workflows; RAG, vector search, enterprise data grounding, Azure services, API integrations, AI governance, risk management, model validation frameworks, conversation flows, prompt maps, and AI interaction diagrams.
Categories
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.