Accenture

LLM Operations Engineer

Accenture
Apply
7 hours ago
Bengaluru, IndiaMid Level / Senior

Responsibilities

  • Design and build multi-agent AI systems for planning, reasoning, collaboration, and task execution.
  • Develop LLM-powered applications, agentic workflows, copilots, and autonomous assistants for enterprise processes.
  • Build RAG pipelines, vector-store memory systems, knowledge-graph integrations, and tool-using agents connected to APIs, databases, and enterprise systems.
  • Apply prompt engineering, fine-tuning, prompt chaining, caching, context management, and token optimization to improve LLM performance.
  • Deploy scalable AI solutions using MLOps and LLMOps practices, including monitoring, evaluation, and guardrails.
  • Design agent collaboration protocols and planning approaches such as ReAct, Plan-and-Execute, and Tree of Thought.
  • Ensure AI safety, governance, security, compliance, and responsible AI practices.
  • Translate business workflows into production agent pipelines and balance latency, cost, and accuracy.

Requirements

  • At least 5 years of overall experience is required.
  • The role specifies 3–8 years of AI/ML experience with a strong focus on generative AI, including at least 3 years of generative AI experience.
  • 15 years of full-time education is required.
  • Strong Python development skills are required.
  • Experience with multi-agent orchestration, role-based coordination, autonomous systems, enterprise copilots, and API-driven tool integration is required.
  • Experience with OpenAI, Hugging Face Transformers, LangChain, AutoGen, CrewAI, Semantic Kernel, FAISS, Pinecone, and Weaviate is expected.
  • Knowledge of LLM evaluation frameworks, graph-based reasoning, knowledge graphs, prompt optimization, chain-of-thought reasoning, and tool augmentation is expected.
  • Experience with cloud platforms is required, with Azure OpenAI preferred and AWS or GCP accepted.
  • Knowledge of Docker, Kubernetes, and CI/CD pipelines is required.
  • Experience in industrial, energy, or IoT environments is a preferred domain qualification.
  • Strong systems thinking, problem decomposition, stakeholder communication, and production-focused innovation are expected.

Benefits

  • The position is based at the company’s Pune office.
Accenture

About Accenture

10,000+ employees

Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.

Contact me