Ernst and Young

AI Systems Engineer - DevOps& Observability Manager

Ernst and Young
Apply
29 days ago
Atlanta, GA, USAStaff+
H1B sponsor

Base Salary

$126k - $262k/yr

Responsibilities

  • Build and operate CI/CD/CV pipelines for AI services, agents, and runtime components, including automated build, testing, continuous verification, release, and rollback.
  • Own governance and discovery for AI assets, including registries, model metadata, experiment tracking, vulnerability and SBOM scanning, lineage, and license management.
  • Manage quotas, rate limits, cost attribution, and utilization so AI execution remains economically bounded by tenant and engagement.
  • Own metrics, logs, traces, dashboards, LLM debugging, evaluation, SLA monitoring, and alerting across the AI platform.
  • Operate the OpenTelemetry collection layer, including multi-tenant receivers, exporters, queues, GPU telemetry, batching, and dynamic filtering.
  • Use telemetry, evaluation, and cost signals to guide deployment decisions, progressive rollouts, and automated rollback.
  • Ensure cost and telemetry data is identity-stamped and attributable to individual tenants and workloads.
  • Define ownership boundaries and consumption contracts with platform, trust, and data engineering teams.

Requirements

  • Bachelor’s or master’s degree in computer science or a related technical field.
  • At least 8 years of experience in DevOps, MLOps, platform, or observability engineering, including hands-on production ownership of AI or high-throughput services.
  • Strong hands-on experience with CI/CD/CV pipelines, GitOps tooling, automated release, and rollback.
  • Hands-on expertise operating Ray Serve, vLLM, Triton, or NIM on GPU infrastructure.
  • Strong experience with Prometheus, Grafana, Loki, Tempo or Jaeger, and OpenTelemetry.
  • Experience with API gateways and request routing, including streaming responses, using Envoy or an equivalent.
  • Experience with OpenCost, Kubecost, or equivalent FinOps tooling, plus quota and rate-limit enforcement.
  • Familiarity with model and artifact registries, supply-chain scanning, SBOMs, compliance constraints, and license or lineage tracking.
  • Ability to operate consistently across cloud, on-premises, edge, and air-gapped environments.
  • Preferred experience with LangSmith or Langfuse, sandboxed execution using gVisor or Firecracker, DCGM GPU telemetry, OpenLineage, AI license management, tenant-level cost attribution, and regulated delivery environments.

Benefits

  • Base salary ranges from $125,500 to $230,200 in most US locations, with higher ranges for specified metropolitan and California offices.
  • Medical and dental coverage, pension and 401(k) plans, paid holidays, winter and summer breaks, personal and family care leave, and other leave options.
  • Flexible vacation policy and support for physical, financial, and emotional well-being.
  • The role may be based anywhere in the country, and EY accepts applications on an ongoing basis.

Tech Stack

AmbassadorApache KafkaArgo CDGitHub ActionsGitLab CI/CDGrafanaHelmMLflowNimPrometheus
Ernst and Young

About Ernst and Young

10,000+ employees

Ernst & Young (EY) provides audit/assurance, tax, consulting, strategy and transactions services to enterprises, financial institutions, and public‑sector clients. Structured as a global network of partner‑owned member firms, it sells professional services on a fee basis, including a dedicated Financial Services Organization for banking, insurance, and capital markets. Headquartered in London, EY was formed in 1989 from the merger of Ernst & Whinney and Arthur Young, and operates in 150+ countries.

Contact me