Cyber CST | Assistant Manager | AI Risk Management | Bengaluru |
Deloitte Advisory2 months ago
Bengaluru, IndiaStaff+
Responsibilities
- Design and develop enterprise-grade applications using commercial and open-source large language models.
- Build LLM workflows with prompt engineering, structured outputs, tool or function calling, and model routing.
- Design retrieval architectures, including RAG and GraphRAG solutions.
- Evaluate and select models based on quality, latency, throughput, concurrency, context limits, and cost.
- Create model abstraction and fallback strategies to reduce dependence on a single LLM provider.
- Optimize LLM applications for latency, token utilization, and inference cost.
- Design single-agent and multi-agent architectures for complex enterprise workflows.
- Build agent workflows using LangGraph or equivalent orchestration frameworks.
- Determine when agentic AI is appropriate versus deterministic orchestration or traditional software workflows.
- Design systems that operate reliably under real-world constraints including security, scalability, and failure recovery.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Electronics and Communication, or Electrical Engineering from a Tier 1 or Tier 2 institution, or an MCA from a recognized university.
- Strong hands-on experience with Python, machine learning and LLM concepts, retrieval architectures, agent orchestration, backend engineering, cloud deployment, and AI evaluation.
- Understanding of LLM inference concepts including tokenization, embeddings, attention, context windows, temperature, top-p/top-k sampling, and token generation.
- Experience designing AI systems beyond prototypes for production reliability, latency, concurrency, security, scalability, cost, and failure recovery.
- Experience with LangGraph or an equivalent agent orchestration framework.
Tech Stack
Categories
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.