Accenture

LLM Operations Engineer

Accenture
Apply
1 day ago
Bengaluru, IndiaMid Level / Senior

Responsibilities

  • Design and build multi-agent AI systems for planning, reasoning, collaboration, and task execution.
  • Develop LLM-powered applications, agentic workflows, AI copilots, and autonomous assistants for enterprise processes.
  • Build RAG pipelines, vector-store and knowledge-graph memory mechanisms, and API- or tool-integrated agents.
  • Implement prompt engineering, prompt chaining, fine-tuning, caching, context management, and token optimization strategies.
  • Deploy scalable AI solutions using MLOps and LLMOps practices, including monitoring, evaluation, and guardrails.
  • Ensure AI safety, governance, security, compliance, and responsible AI practices.
  • Translate business workflows into agent pipelines and balance latency, cost, and accuracy in production systems.

Requirements

  • At least 3 years of experience in Generative AI; the professional experience range is stated as 3–8 years in AI/ML.
  • Strong Python development skills and experience building autonomous systems, copilots, multi-agent orchestration systems, and API-driven AI agents.
  • Hands-on experience with LLMs, Generative AI frameworks, agent frameworks, RAG pipelines, vector databases, and LLM evaluation frameworks.
  • Knowledge of agent planning methods such as ReAct, Plan-and-Execute, and Tree of Thought, along with graph-based reasoning and knowledge graphs.
  • Experience with OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, and Weaviate.
  • Experience with cloud platforms, preferably Azure OpenAI, with AWS and GCP acceptable, plus Docker and Kubernetes knowledge.
  • Understanding of prompt optimization, chain-of-thought reasoning, tool augmentation, context management, and token optimization.
  • Strong systems thinking, problem decomposition, stakeholder communication, and ability to apply agentic AI in production.
  • Domain experience in industrial, energy, or IoT environments is relevant.

Benefits

  • The position is based at the employer’s Pune office.

Tech Stack

Categories

Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me