Accenture

Large Language Model Architect

Accenture
Apply
20 hours ago
Pune, IndiaStaff+

Responsibilities

  • Define enterprise AI strategy, target-state architecture, reference architectures, technology selections, and investment roadmaps.
  • Architect Azure AI Foundry and Azure OpenAI platforms for agentic workflows, RAG, tool integration, context engineering, and enterprise knowledge grounding.
  • Own end-to-end technical solutions across platforms, data, models, applications, operating models, and enterprise integrations.
  • Set architectural direction for multi-agent systems, orchestration, memory, tool use, agent registries, AI gateways, control planes, risk scoring, and certification gates.
  • Define context-layer architecture using knowledge graphs, ontologies, vector search, semantic retrieval, prompt and context assembly, conversational state, and reusable memory services.
  • Establish identity, authorization, guardrails, prompt-injection defenses, PII protection, audit logging, lineage, and defense-in-depth controls.
  • Mandate evaluation and observability practices covering accuracy, relevance, groundedness, model quality, latency, cost, safety, reliability, and production support.
  • Establish AI FinOps practices including usage labeling, token budgets, cost planning, threshold alerts, and optimization levers.
  • Produce and steward enterprise AI blueprints, ADRs, sequence diagrams, solution patterns, interface specifications, reference architectures, and governance playbooks.
  • Lead multiple domain architects and senior SMEs and advise executive, business, technology, security, product, and delivery leaders.

Requirements

  • Bachelor's degree or equivalent in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline.
  • At least 15 years of overall experience across software engineering, data engineering, AI/ML engineering, cloud architecture, enterprise architecture, or technology leadership.
  • At least 8 years designing and deploying enterprise-grade AI, data, analytics, or cloud-native solutions using a cloud vendor.
  • At least 2 years of LLM and generative AI solution architecture experience, including agentic systems, RAG, prompt engineering, model integration, and evaluation patterns.
  • At least 2 years architecting and operationalizing LLM-driven application patterns in enterprise-scale or production environments.
  • At least 6 years of experience in engineering, machine learning, deep learning, NLP, data engineering, or large-scale analytical engineering.
  • At least 6 years as a machine learning, data, or AI architect designing large-scale analytical engineering solutions in industry contexts.
  • Deep hands-on experience with Microsoft Foundry, Azure AI Foundry, Foundry Agent Service, Azure OpenAI models, Azure AI Search, Prompt Flow, Azure Functions, Logic Apps, API Management, Event Grid, Microsoft Fabric, Entra ID, Key Vault, Azure Monitor, and Application Insights.
  • Strong expertise in RAG, embeddings, vector databases, semantic retrieval, context engineering, model routing, agent orchestration, memory, tool calling, AI gateways, and model evaluation.
  • Experience defining enterprise non-functional requirements, architectural controls, reference architectures, technology selections, foundation-model approaches, deployment approaches, governance, observability, resiliency, and cost optimization.
  • Preferred experience includes Azure Solutions Architect Expert, Azure AI Engineer Associate, or Azure Developer certifications; Microsoft Fabric, Semantic Kernel, private endpoints, Defender for Cloud, Microsoft 365 Copilot extensibility, Responsible AI governance, and enterprise integration patterns.
  • Preferred exposure to LangChain, LangGraph, LlamaIndex, Haystack, MLflow, FastAPI, Docker, Kubernetes, responsible AI, model risk management, red-teaming, synthetic data, human-in-the-loop review, A/B testing, and GenAI FinOps.
  • Recognized thought leadership through enterprise reference architectures, capability building, client advisory, accelerators, publications, whitepapers, conference sessions, or industry forums.
Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me