Accenture

Large Language Model Architect

Accenture
Apply
16 hours ago
Bengaluru, IndiaStaff+

Responsibilities

  • Translate business strategy and product goals into technical visions, architecture blueprints, non-functional requirements, and implementation roadmaps.
  • Lead stakeholder workshops covering feasibility, scope, solution boundaries, dependencies, and client-facing expectations.
  • Design GCP generative AI architectures using Gemini, Model Garden, BigQuery, Vertex AI Search, vector stores, Cloud Run, and GKE.
  • Architect model- and tool-agnostic multi-agent systems with orchestration, tool use, memory, context management, and reusable service abstractions.
  • Design data and context layers covering ingestion, preprocessing, synchronization, chunking, embeddings, vector search, knowledge graphs, and semantic retrieval.
  • Define evaluation frameworks for accuracy, relevance, groundedness, latency, cost, safety, security, and operational reliability.
  • Establish AI security, governance, observability, guardrails, prompt-injection defenses, PII protection, access controls, audit logging, and tracing.
  • Create architecture decision records, component and sequence diagrams, design specifications, integration patterns, and reusable reference architecture assets.

Requirements

  • A bachelor's degree or equivalent in computer science, computer engineering, data science, AI/ML, information technology, or a related engineering discipline.
  • At least 12 years of experience is required; the qualifications also specify 10+ years in software engineering, data engineering, AI/ML engineering, or technology architecture.
  • At least 5 years designing and deploying enterprise-grade advanced AI or cloud data solutions using a cloud vendor.
  • At least 2 years of experience in agentic AI, LLM, and generative AI solution architecture or engineering delivery.
  • At least 4 years of Python coding experience and experience with APIs, distributed systems, reusable frameworks, and cloud-native application patterns.
  • At least 4 years of experience in machine learning, deep learning, NLP, data engineering, analytical engineering, or AI product delivery.
  • Demonstrated solution or technology architecture experience in industries such as financial services, healthcare, retail, manufacturing, telecom, or media.
  • Hands-on experience with Google Cloud AI, data, compute, networking, logging, monitoring, and security services, including Vertex AI, Gemini, BigQuery, GKE, Cloud Run, IAM, and VPC Service Controls.
  • Strong knowledge of LLM architecture patterns, including RAG, embeddings, vector databases, prompt engineering, model routing, fine-tuning, function calling, tool integration, and agent orchestration.
  • Experience building reusable agent services, memory services, API gateways, integration adapters, orchestration layers, evaluation harnesses, deployment pipelines, and enterprise platform patterns.
  • Experience with CI/CD, infrastructure-as-code, automated testing, model evaluation, MLOps/LLMOps, monitoring, and production release governance.
  • Strong stakeholder management and communication skills for explaining architecture trade-offs, risks, and recommendations to engineering, product, security, and leadership teams.
  • Preferred qualifications include Google Cloud certifications, experience with Dataform/dbt, Vertex AI pipelines, LangChain, LlamaIndex, responsible AI, model risk management, red-teaming, human-in-the-loop review, A/B testing, and GenAI FinOps.
  • Additional preferred exposure includes LangGraph, Haystack, Semantic Kernel, MLflow, FastAPI, Docker, Kubernetes, and GCP security perimeter controls.

Tech Stack

dbtDockerFastAPIGoogle BigQueryGoogle Cloud PlatformKubernetesMLflowPython
Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me