23 hours ago
Bengaluru, IndiaMid Level / Senior
Responsibilities
- Write code and automation using retries, timeouts, circuit breakers, rate limiting, graceful degradation, and model/provider fallback to improve GenAI reliability.
- Run load tests, failure-injection tests, game days, and recovery tests, then remediate the weaknesses identified.
- Harden Kubernetes services with health checks, autoscaling, disruption budgets, resource limits, and multi-zone deployment.
- Plan capacity for model-provider quotas, GPU and inference capacity, databases, launches, and growth.
- Maintain and regularly test backup, restore, and disaster-recovery plans.
- Define and track service-level indicators and objectives for availability, latency, error rate, token cost, and quality scores.
- Instrument services with logs, metrics, and traces; build actionable dashboards and alerts for user-facing failures.
- Support release readiness, CI/CD and GitOps deployments, canary rollouts, rollback plans, and infrastructure-as-code workflows.
- Participate in on-call incident response, write blameless post-incident reviews, maintain runbooks, and track corrective actions to completion.
- Support the serving, scaling, rollout, rollback, GPU usage, security, patching, secrets, and data-boundary requirements of self-hosted language models.
Requirements
- 2–4 years of experience in site reliability, DevOps, platform, or software engineering involving production systems.
- Bachelor’s degree in computer science, engineering, or a related field, or equivalent experience.
- Proficiency in Python or Go, with experience in version control, testing, and code review.
- Experience with Linux, containers, Kubernetes, and a major cloud platform, preferably Google Cloud.
- Experience with CI/CD and infrastructure as code such as Terraform.
- Working knowledge of monitoring, logging, tracing, and alerting, plus distributed-system failure and resilience patterns.
- Experience with on-call or incident response and willingness to participate in an on-call rotation.
- Familiarity with LLM applications, including model APIs, retrieval, agents, and tool calls.
- Clear written and verbal communication skills.
- Preferred experience includes running GenAI or ML systems in production, managed model platforms such as Vertex AI, model serving such as vLLM, OpenTelemetry, Prometheus, Grafana, PagerDuty, GitOps, Argo CD, Helm, canary deployments, load testing, chaos engineering, Vault, security scanning, and automation or AI agents that reduce operational work.
Tech Stack
Categories
Site Reliability
About Equinix
Equinix is a public digital infrastructure company that operates a global platform of colocation and interconnection data centers for enterprises, cloud and network providers. It sells space, power, and connectivity, plus services such as Equinix Fabric, Network Edge, and Equinix Metal for hybrid multicloud and edge deployments. Founded in 1998 and headquartered in Redwood City, California, it is listed on NASDAQ (EQIX) and runs hundreds of IBX facilities across major metros worldwide.
