Accenture

Large Language Model Architect

Accenture
Apply
3 days ago
Bengaluru, IndiaSenior

Responsibilities

  • Design and build LLM application components, including prompts, tools, agents, orchestration, memory and context handling, retrieval pipelines, and evaluation harnesses.
  • Create enterprise agents with tools, knowledge, and memory, integrating Azure AI Search, API Management, Logic Apps, Functions, tracing, evaluations, guardrails, and policy controls.
  • Implement data ingestion, parsing, chunking, enrichment, embeddings, vector search, and retrieval workflows for structured and unstructured enterprise content.
  • Engineer PII controls, prompt-injection defenses, content filters, guardrails, authentication, authorization, lineage, and audit logging.
  • Collaborate with architects, data engineers, product owners, and security stakeholders to deliver tested, observable, and maintainable software components.
  • Maintain component designs, integration specifications, deployment runbooks, evaluation results, and reusable engineering patterns.

Requirements

  • Bachelor's degree in Computer Science, Computer Engineering, Data Science, AI/ML, Information Technology, or a related engineering discipline.
  • At least 5 years of software, data, or AI engineering experience, including 2 years of cloud-native engineering and 1 year of GenAI, LLM, NLP, or agentic AI delivery; an alternative path requires 7 years of experience with specified cloud and GenAI experience.
  • Hands-on Python coding experience and strong understanding of APIs, distributed systems, testing, observability, and secure SDLC practices.
  • Experience with Microsoft Foundry/Azure AI Foundry, Foundry Agent Service, Azure OpenAI models, Azure AI Search, Prompt Flow, Azure Functions, Logic Apps, API Management, Event Grid, Microsoft Fabric, Entra ID, Key Vault, Azure Monitor, and Application Insights.
  • Understanding of LLM application architecture, including RAG, function and tool calling, agent orchestration, model invocation, prompt engineering, embeddings, vector databases, and evaluation metrics.
  • Experience implementing traditional ML and GenAI components across ingestion, data preparation, model integration, deployment, monitoring, and continuous improvement.
  • Experience with security, privacy, governance, performance, scalability, reliability, and cost controls for production AI systems.
  • Experience with Git-based development, automated testing, CI/CD pipelines, infrastructure-as-code, and agile delivery in client-facing environments.
  • Preferred qualifications include Azure AI Engineer, Azure Solutions Architect, or Azure Developer certification; Microsoft Fabric, Semantic Kernel, Prompt Flow, private networking, Defender for Cloud, and Responsible AI governance experience; and exposure to LangChain, LangGraph, LlamaIndex, Haystack, MLflow, FastAPI, Docker, and Kubernetes.

Tech Stack

Categories

Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me