Manager | AI / ML | Bengaluru | Artificial Intelligence & Data | AI Insights & Engagement
Deloitte Advisory7 days ago
Bengaluru, IndiaStaff+
Responsibilities
- Design, develop, and operate enterprise AI platforms for generative AI, agentic AI, AI copilots, and intelligent automation.
- Build multi-agent systems with reasoning, planning, tool calling, workflow execution, and human-in-the-loop interactions.
- Develop RAG solutions, AI services, REST APIs, orchestration pipelines, governance controls, and reusable software components.
- Deploy and manage private or local AI environments using open-source LLMs and enterprise AI platforms.
- Develop scalable Python backend services and microservices while leading code reviews and enforcing engineering, security, and architecture standards.
- Design and maintain highly available cloud and on-premises infrastructure platforms.
- Implement infrastructure as code with Terraform, Ansible, Kubernetes, and Vault, plus automated CI/CD pipelines.
- Implement monitoring, logging, alerting, observability, self-healing, capacity planning, release governance, and production support.
- Lead technical discussions and architecture reviews, mentor engineers, and promote adoption of AI engineering and cloud-native best practices.
- Collaborate with business, architecture, security, infrastructure, and global stakeholder teams to identify automation opportunities and promote responsible AI.
Requirements
- 7+ years of software engineering, platform engineering, DevOps, or infrastructure automation experience, including strong Python expertise.
- At least 2 years of hands-on experience delivering generative AI, agentic AI, AI copilots, or enterprise AI platform solutions.
- Experience designing REST APIs, microservices, scalable backend services, secure code, design patterns, testing, and modern software engineering practices.
- Hands-on experience with agentic AI frameworks or platforms such as LangChain, LangGraph, CrewAI, AutoGen, Semantic Kernel, LlamaIndex, Azure AI Foundry, Azure OpenAI Services, or OpenAI APIs.
- Experience building AI agents, multi-agent systems, AI copilots, conversational AI, workflow automation agents, or knowledge management assistants.
- Strong understanding of prompt engineering, RAG architectures, tool and function calling, AI evaluation, guardrails, and hallucination mitigation.
- Experience deploying private or local AI using Ollama, Open WebUI, vLLM, Hugging Face Transformers, Text Generation Inference, or LM Studio.
- Experience deploying or managing open-source models such as Llama, Mistral, DeepSeek, Qwen, Phi, or Gemma, plus GPU infrastructure, inference optimization, model lifecycle management, and AI platform governance.
- Experience with vector databases or search platforms such as Pinecone, ChromaDB, Qdrant, Milvus, Weaviate, or Azure AI Search, and knowledge of embeddings, semantic search, knowledge retrieval, or document intelligence.
- Strong experience with AWS or Microsoft Azure, Docker, Kubernetes, Terraform, Ansible, and GitHub Actions, GitLab CI, or Azure DevOps.
- Experience in large-scale, mission-critical, 24x7 enterprise environments; banking or financial services experience and AI governance or regulatory compliance exposure are preferred.
- Angular, React, JavaScript, or TypeScript experience is preferred.
- Bachelor's or master's degree in Computer Science, Engineering, Information Technology, MCA, or a related discipline.
Tech Stack
AngularAnsibleAWSAzureDockerGitHub ActionsGitLab CI/CDHugging Face TransformersJavaScriptKubernetesPythonReactTerraformTypeScriptVault
Categories
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.