Director | AI / ML | Delhi | Engineering | Hybrid Cloud Engineering
Deloitte Advisory1 month ago
Delhi, IndiaStaff+
Responsibilities
- Build and maintain on-premises GPU infrastructure, including NVIDIA DGX systems, GPU clusters, and storage.
- Configure GPU scheduling, resource quotas, and multi-instance GPU using Kubernetes or Run.
- Deploy and optimize model-serving platforms including vLLM, Triton, and TensorRT-LLM.
- Manage containerization, networking, access controls, and security monitoring for AI workflows.
- Provide self-service AI development environments using Jupyter and Kubeflow.
- Support large-scale mainframe modernization, cloud adoption, and enterprise transformation for global financial institutions.
Requirements
- Full-time bachelor's degree in engineering.
- 15+ years of overall experience.
- 4–8+ years of experience in DevOps, SRE, or AI infrastructure operations.
- Strong expertise in Linux administration, Docker, and Kubernetes.
- Hands-on experience with NVIDIA CUDA, NCCL, and GPU performance tuning.
- Familiarity with model-serving runtimes, MLflow, Kubeflow, or Red Hat OpenShift AI.
- Proficiency in Python and infrastructure automation tools such as Terraform and Ansible.
Tech Stack
Categories
About Deloitte Advisory
Deloitte Advisory provides consulting and managed services that help organizations manage risk, strengthen controls, investigate fraud, meet regulatory requirements, and execute transactions using analytics and industry expertise. Offerings span cybersecurity, M&A due diligence, finance and regulatory transformation, internal audit, and tech-enabled platforms. It is part of Deloitte’s global network (founded in 1845 and privately held), with U.S. member-firm teams serving corporations and government agencies across sectors.