
AI Systems Engineer - DevOps& Observability Manager
Ernst and Young29 days ago
Base Salary
$126k - $262k/yr
Responsibilities
- Build and operate CI/CD/CV pipelines for AI services, agents, and runtime components, including automated build, testing, continuous verification, release, and rollback.
- Own governance and discovery for AI assets, including registries, model metadata, experiment tracking, vulnerability and SBOM scanning, lineage, and license management.
- Manage quotas, rate limits, cost attribution, and utilization so AI execution remains economically bounded by tenant and engagement.
- Own metrics, logs, traces, dashboards, LLM debugging, evaluation, SLA monitoring, and alerting across the AI platform.
- Operate the OpenTelemetry collection layer, including multi-tenant receivers, exporters, queues, GPU telemetry, batching, and dynamic filtering.
- Use telemetry, evaluation, and cost signals to guide deployment decisions, progressive rollouts, and automated rollback.
- Ensure cost and telemetry data is identity-stamped and attributable to individual tenants and workloads.
- Define ownership boundaries and consumption contracts with platform, trust, and data engineering teams.
Requirements
- Bachelor’s or master’s degree in computer science or a related technical field.
- At least 8 years of experience in DevOps, MLOps, platform, or observability engineering, including hands-on production ownership of AI or high-throughput services.
- Strong hands-on experience with CI/CD/CV pipelines, GitOps tooling, automated release, and rollback.
- Hands-on expertise operating Ray Serve, vLLM, Triton, or NIM on GPU infrastructure.
- Strong experience with Prometheus, Grafana, Loki, Tempo or Jaeger, and OpenTelemetry.
- Experience with API gateways and request routing, including streaming responses, using Envoy or an equivalent.
- Experience with OpenCost, Kubecost, or equivalent FinOps tooling, plus quota and rate-limit enforcement.
- Familiarity with model and artifact registries, supply-chain scanning, SBOMs, compliance constraints, and license or lineage tracking.
- Ability to operate consistently across cloud, on-premises, edge, and air-gapped environments.
- Preferred experience with LangSmith or Langfuse, sandboxed execution using gVisor or Firecracker, DCGM GPU telemetry, OpenLineage, AI license management, tenant-level cost attribution, and regulated delivery environments.
Benefits
- Base salary ranges from $125,500 to $230,200 in most US locations, with higher ranges for specified metropolitan and California offices.
- Medical and dental coverage, pension and 401(k) plans, paid holidays, winter and summer breaks, personal and family care leave, and other leave options.
- Flexible vacation policy and support for physical, financial, and emotional well-being.
- The role may be based anywhere in the country, and EY accepts applications on an ongoing basis.
Tech Stack
Categories
About Ernst and Young
Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.