Accenture

LLM Operations Engineer

Accenture
Apply
18 hours ago
Kolkāta, IndiaMid Level / Senior

Responsibilities

  • Design and build multi-agent AI systems for planning, reasoning, collaboration, and task execution.
  • Develop LLM-powered applications, agentic workflows, AI copilots, and autonomous assistants for enterprise systems.
  • Build RAG pipelines, vector-store and knowledge-graph memory mechanisms, and API- or database-integrated tools.
  • Optimize LLM performance through fine-tuning, prompt chaining, caching, context management, and token optimization.
  • Deploy scalable AI solutions using MLOps and LLMOps practices, including monitoring, evaluation, and guardrails.
  • Design agent collaboration protocols and apply planning approaches such as ReAct, Plan-and-Execute, and Tree of Thought.
  • Ensure AI safety, governance, compliance, and responsible AI practices.

Requirements

  • At least 5 years of experience is required, with 3–8 years of experience in AI/ML and a strong focus on generative AI.
  • At least 3 years of generative AI experience is required.
  • Strong Python development skills and experience building multi-agent orchestration systems, autonomous systems, or enterprise copilots.
  • Experience with OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, and Weaviate.
  • Experience with LLM evaluation frameworks including RAGAS, TruLens, and Promptfoo.
  • Knowledge of prompt engineering, chain-of-thought reasoning, tool augmentation, graph-based reasoning, knowledge graphs, and context optimization.
  • Experience with cloud platforms, with Azure OpenAI preferred and AWS or GCP acceptable.
  • Knowledge of Docker, Kubernetes, and CI/CD pipelines.
  • Experience in industrial, energy, or IoT environments is valued.
  • Strong systems thinking, problem decomposition, stakeholder communication, and ability to balance latency, cost, and accuracy.

Benefits

  • The position is based at the employer’s Pune office.
  • The role offers work on production-focused generative AI, agentic AI, and multi-agent enterprise solutions.

Tech Stack

Categories

Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me