AI Systems Engineer - AI Platforms - Manager
Ernst and Young13 days ago
Base Salary
$126k - $230k/yr
Responsibilities
- Own the cloud-native platform, including compute, Kubernetes, scheduling, cluster fabric, networking, distributed compute, and multi-tenancy.
- Manage infrastructure foundations spanning Ubuntu, operating systems, BMC, bare-metal systems, DPU architecture, GPU infrastructure, and NVAIE.
- Deploy and operate AI environments across EKS, AKS, GKE, RKE2, K3s, cloud, on-premises, edge, and air-gapped targets.
- Deliver infrastructure management, Kubernetes and scheduling, and cluster fabric management capabilities for downstream AI runtime, data, and execution services.
- Own cluster lifecycle, autoscaling, GPU pooling and virtualization, and tenant isolation using vCluster, Crossplane, and Karpenter.
- Manage secure execution and inference with Ray Serve, vLLM, NIM, Triton, NVIDIA Dynamo, gVisor, Firecracker, NVIDIA OpenShell, and vNode.
- Own AI gateway, semantic routing, model and prompt selection, and streaming response handling with Envoy AI Gateway and vLLM-SR.
- Collaborate on CI/CD, infrastructure-as-code, and GitOps delivery using ArgoCD, Helm, and OpenTofu.
- Manage backup, disaster recovery, cross-environment replication, patching, and platform supply-chain hygiene using Velero, CloudNativePG, and Cilium ClusterMesh.
- Define modular platform contracts and ownership boundaries while minimizing vendor lock-in and enabling downstream team velocity, reliability, and portability.
Requirements
- Bachelor’s or master’s degree in computer science or a related technical field.
- At least 8 years of experience building or operating enterprise infrastructure, cloud platforms, or large-scale Kubernetes environments, including hands-on systems depth.
- Deep expertise in cloud-native platform engineering, Kubernetes, networking, multi-tenancy, bare-metal systems, GPU infrastructure, and DPU architecture.
- Hands-on experience with Kubernetes distributions and cluster lifecycle management, including RKE2, EKS, AKS, GKE, and K3s.
- Experience with bare-metal, cloud, hybrid, on-premises, and ideally air-gapped deployment models.
- Strong grounding in cluster networking, Cilium, service mesh, CNI, storage, and multi-tenant isolation.
- Experience with GPU infrastructure and scheduling, including NVAIE, DCGM, GPU operators, virtualization, and MIG.
- Experience with infrastructure-as-code and GitOps tooling, including Terraform, OpenTofu, Helm, ArgoCD, and Crossplane.
- Track record operating production infrastructure under compliance, security, or regulatory constraints.
- Ability to work with security, architecture, product, delivery, data, runtime, and trust teams and communicate infrastructure tradeoffs effectively.
- Preferred experience supporting AI/ML and GPU-intensive workloads, multi-tenant platforms, disaster recovery, backup, replication, distributed compute, and batch orchestration.
- Preferred familiarity with vCluster, Kueue, Slurm/Slinky, Ray, OpenMPI, and platform or SRE roles measured by downstream velocity, reliability, and portability.
Benefits
- Base salary is listed as $125,500 to $230,200 for all US geographic locations and $150,700 to $261,600 for New York City Metro Area, Washington State, and California excluding Sacramento.
- Medical and dental coverage, pension and 401(k) plans, paid time off, EY paid holidays, winter and summer breaks, personal and family care leave, and other leave options.
- Flexible vacation policy and a flexible, team-led and leader-enabled hybrid model, with most external client-serving employees expected to work in person 40–60% of the time during an engagement, project, or year.
- Applications are accepted on an ongoing basis.
Tech Stack
Categories
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.