Zimperium

Lead DevOps Engineer (AI & GPU)

Zimperium
Apply
23 hours ago
Bengaluru, IndiaStaff+

Responsibilities

  • Build and operate CI/CD/CV pipelines for AI services, agents, and runtime components, including automated build, testing, continuous verification, release, and rollback.
  • Own AI asset governance and discovery through registries, model metadata, experiment tracking, vulnerability and SBOM scanning, lineage contracts, and license management.
  • Implement resource and cost management with quotas, rate limits, per-tenant cost attribution, and utilization controls.
  • Own observability across metrics, logs, traces, dashboards, LLM debugging and evaluation, SLA monitoring, and alert notifications.
  • Build and operate the OpenTelemetry collection layer with multi-tenant receivers, exporters, queues, GPU telemetry, batching, and dynamic filtering.
  • Automate GitOps delivery and embed quality, integrity, compliance, and cost gates into deployment pipelines.
  • Use telemetry, evaluation, and cost signals to drive deployment decisions, progressive rollouts, and automated rollback.
  • Ensure cost and telemetry data is identity-stamped and attributable per tenant and workload across cloud, on-premises, edge, and air-gapped environments.

Requirements

  • 8+ years of experience in DevOps, MLOps, platform, or observability engineering with hands-on production ownership of AI or high-throughput services.
  • Bachelor’s or Master’s degree in Computer Science or a related technical field.
  • Strong expertise in CI/CD/CV pipeline design, GitOps, continuous verification, progressive delivery, and automated rollback.
  • Hands-on production experience operating Ray Serve, vLLM, Triton, or NIM on GPU infrastructure.
  • Strong experience with Prometheus, Grafana, Loki, Tempo or Jaeger, and OpenTelemetry.
  • Experience with Envoy or an equivalent API gateway and request-routing system, including streaming responses.
  • Experience with OpenCost, Kubecost, or equivalent FinOps tooling, plus quota and rate-limit enforcement.
  • Familiarity with Harbor, MLflow, Trivy/SBOM scanning, model and artifact registries, supply-chain security, license tracking, and lineage.
  • Experience operating AI or service infrastructure under compliance, security, or regulatory constraints across cloud, on-premises, edge, or air-gapped environments.
  • Ability to define ownership boundaries and consumption contracts with platform, trust, and data teams, and communicate runtime, cost, and observability tradeoffs to technical and executive stakeholders.
  • Preferred experience with LangSmith, Langfuse, gVisor, Firecracker, microVM isolation, DCGM, OpenLineage, AI license management, multi-tenant cost attribution, per-tenant SLA and alerting, and regulated delivery environments.

Tech Stack

AmbassadorApache KafkaArgo CDGitHub ActionsGitLab CI/CDGrafanaHelmMLflowNimPrometheus

Categories

Zimperium

About Zimperium

201-500 employees

Zimperium builds enterprise mobile security software that protects iOS and Android devices and applications through on-device threat detection, phishing and malware defense, and app shielding/SDKs. It sells subscriptions and services to enterprises and public-sector organizations to manage mobile risk and secure apps at scale. Founded in 2010 and headquartered in Dallas, the company is owned by Liberty Strategic Capital.

Contact me