Accenture

LLM Operations Engineer

Accenture
Apply
11 hours ago
Bengaluru, IndiaSenior

Responsibilities

  • Design and build multi-agent AI systems for planning, reasoning, collaboration, and task execution.
  • Develop LLM applications, AI copilots, autonomous assistants, and agentic workflows using prompt engineering and orchestration.
  • Build RAG pipelines, vector-store and knowledge-graph memory mechanisms, and tool-using agents integrated with APIs, databases, and enterprise systems.
  • Deploy scalable AI solutions using MLOps and LLMOps practices, including monitoring, evaluation, guardrails, caching, and performance optimization.
  • Design multi-agent collaboration protocols and optimize latency, cost, and accuracy.
  • Ensure AI safety, governance, security, compliance, and responsible AI practices.

Requirements

  • At least 5 years of experience is required, with 3–8 years of experience in AI/ML and at least 3 years in Generative AI stated elsewhere in the posting.
  • 15 years of full-time education is required.
  • Strong Python development skills and experience building API-driven, tool-integrated AI agents.
  • Experience with multi-agent orchestration, agent planning algorithms, LLM evaluation frameworks, graph-based reasoning, knowledge graphs, and enterprise copilots or autonomous systems.
  • Hands-on experience with OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, and Weaviate.
  • Experience with cloud platforms, preferably Azure OpenAI, with AWS and GCP accepted; knowledge of Docker and Kubernetes.
  • Understanding of prompt engineering, chain-of-thought reasoning, tool augmentation, context management, and token optimization.
  • Experience balancing latency, cost, and accuracy and translating business workflows into agent pipelines.
  • Domain experience in industrial, energy, or IoT environments is noted.

Benefits

  • The position is based at the company's Pune office.
Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me