AI Platform Support Engineer
ClearRoute8 hours ago
Pune, IndiaMid Level
Responsibilities
- Monitor the health, latency, availability, error rates, token usage, cost, and evaluation metrics of AI services and LLM workloads.
- Triage, investigate, resolve, and document incidents involving APIs, rate limiting, model output quality, and platform infrastructure.
- Participate in a shared production on-call rota and conduct root-cause analysis with blameless post-incident reviews.
- Build and maintain dashboards, alerts, logging, runbooks, deployment pipelines, and automation for AI platforms.
- Manage vector databases, embedding pipelines, data ingestion jobs, and deployments for models, prompts, agents, and RAG components.
- Serve as the escalation point for delivery teams and client users, support onboarding, and communicate recurring issues to engineering and product owners.
Requirements
- At least 3 years of experience in platform support, site reliability engineering, DevOps, or production support for cloud-hosted services.
- Hands-on experience supporting applications built on LLM APIs such as OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, or Google Vertex AI.
- Strong working knowledge of at least one major cloud platform: AWS, Azure, or GCP.
- Practical experience with Docker, Kubernetes, Python, Bash or PowerShell, observability tooling, CI/CD, and infrastructure as code.
- Working knowledge of REST APIs, authentication, networking fundamentals, log analysis, and incident management.
- Preferred experience includes RAG architectures, vector databases, agent and orchestration frameworks, LLM observability and evaluation tools, open-weight model serving, AI governance, cloud or Kubernetes certifications, and consultancy or client-facing delivery.
Benefits
- Genuine hybrid working and a home office budget.
- Profit share, recognition programs, private healthcare, competitive salary benchmarking, and an employee assistance program covering counselling, mental health, and financial wellbeing.
- Learning budgets, Udemy access, a clear career framework, internal mobility, and thought leadership opportunities.
- Paid time off including birthday leave, interest-based communities, monthly socials, and cross-regional events.
- Family-friendly flexibility, accessibility support during the interview process, and an inclusive collaborative culture.
Tech Stack
AWSAzureBashDatadogDockerGitHub ActionsGitLab CI/CDGoogle Cloud PlatformGrafanaKubernetesPowerShellPrometheusPythonTerraform
Categories
DevOpsSite Reliability
About ClearRoute
ClearRoute is a London‑headquartered platform engineering consultancy that helps enterprises improve software delivery across cloud platforms, quality engineering, and developer experience. Founded in 2022, it provides advisory and hands‑on engineering services, applying its QCE framework to streamline routes to production and manage security, compliance, and scalability in complex, regulated, multi‑vendor environments.