3 days ago
Bengaluru, IndiaSenior
Responsibilities
- Design and implement multi-agent orchestration pipelines with conditional routing, retry loops, and supervisor/sub-agent hierarchies.
- Engineer RAG systems covering chunking, embeddings, vector search, re-ranking, context management, and grounding.
- Build knowledge graphs and hybrid retrieval combining graph traversal with vector similarity.
- Implement prompt versioning, multi-model routing, fallback strategies, structured-output guardrails, validation, self-correction, and safety filtering.
- Build LLM evaluation harnesses with golden datasets, automated scoring, regression gates, and hallucination or grounding checks.
- Serve and optimize on-premises LLMs using vLLM and cloud OpenAI-compatible APIs, including batching, streaming, and context-window management.
- Instrument AI systems for token, latency, cost, trace, and provenance observability.
- Integrate A2A and MCP protocols and connect agents to enterprise tools through REST and GraphQL.
Requirements
- Minimum 7.5 years of professional experience is required.
- 7-8 years of professional software engineering experience, including 3+ years building LLM, agent, or ML systems in production.
- At least 5 years of Python experience, including strong asynchronous Python development.
- Hands-on experience with LangGraph, LangChain, or an equivalent agent framework.
- Demonstrated experience with RAG, vector search, or knowledge-graph retrieval.
- Experience taking AI features from prototype through grounded, evaluated, production-ready systems.
- Knowledge of LLM evaluation, guardrails, observability, prompt design, token budgeting, and multi-model routing.
- Experience with 15 years of full-time education.
- Fluent communication skills.
- Preferred experience includes ontology modeling, Redis and mem0 agent memory, Ray workflow execution, A2A, MCP, AG-UI, fine-tuning, LoRA, quantization, vector databases, sentence-transformers, Neo4j, and Cypher.
Benefits
- The position is based at the employer's Bengaluru office.
Tech Stack
Categories
About Accenture
Accenture is a global professional services firm providing management consulting, systems integration and technology, cybersecurity, and business process outsourcing for enterprises and governments. It operates a services-driven model delivering projects and managed services, often with major cloud and software partners, across industries worldwide. Headquartered in Dublin and publicly traded on the NYSE (ACN), it originated as Andersen Consulting and adopted the Accenture name in 2001.