Accenture

LLM Operations Engineer

Accenture
Apply
7 hours ago
Chennai, IndiaMid Level / Senior

Responsibilities

  • Design and build multi-agent AI systems capable of planning, reasoning, collaboration, and task execution.
  • Develop LLM-powered applications, agentic workflows, copilots, and autonomous assistants using prompt engineering and orchestration.
  • Build RAG pipelines, vector-store and knowledge-graph memory systems, and tool-using agents integrated with APIs, databases, and enterprise systems.
  • Deploy scalable AI solutions using MLOps and LLMOps practices, including monitoring, evaluation, caching, fine-tuning, and guardrails.
  • Design agent collaboration protocols and optimize LLM systems for latency, cost, and accuracy.
  • Ensure AI safety, governance, compliance, security, and responsible AI practices.

Requirements

  • Minimum 3 years of experience in Generative AI; the stated experience range is 3–8 years in AI/ML.
  • 15 years of full-time education.
  • Strong Python development skills and experience building multi-agent orchestration systems.
  • Experience with LLMs, Generative AI frameworks, prompt engineering, tool augmentation, context management, and token optimization.
  • Hands-on experience with OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, and Weaviate.
  • Experience with LLM evaluation frameworks such as RAGAS, TruLens, and Promptfoo.
  • Experience with cloud platforms, preferably Azure OpenAI, with AWS and GCP also acceptable.
  • Knowledge of Docker, Kubernetes, CI/CD pipelines, graph-based reasoning, knowledge graphs, and autonomous enterprise systems.
  • Ability to translate business workflows into agent pipelines and balance LLM latency, cost, and accuracy.
  • Domain experience in industrial, energy, or IoT environments is relevant.

Benefits

  • The position is based at the Pune office.

Tech Stack

Categories

Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me