Staff AI Platform Engineer, Infrastructure Services
SentinelOne3 months ago
Base Salary
$156k - $215k/yr
Responsibilities
- Architect, harden, scale, and operate the Kong AI Gateway deployment across authentication, consumer tiers, budgets, rate limiting, semantic caching, and observability.
- Lead root-cause analysis, remediation, monitoring, alerting, incident response, and reliability improvements for gateway performance and availability.
- Design solutions across CI/CD, GitOps, Kubernetes deployment tooling, artifact management, GitHub administration, and Actions runner infrastructure.
- Evaluate and roll out AI developer tooling and engineering metrics platforms through structured pilots and build-versus-buy recommendations.
- Set technical direction and architecture standards for AI infrastructure, review designs, and mentor engineers.
- Partner with security, DevEx, and product engineering teams to translate platform needs into gateway capabilities.
- Deploy and operate self-hosted and open-weight model-serving infrastructure, including GPU capacity planning, autoscaling, and cost/performance tuning.
- Support LLMOps practices including model versioning, evaluation, safe rollout, vector stores, embedding pipelines, and RAG infrastructure.
- Build observability for token usage, latency, and spending across API-based and self-hosted models.
Requirements
- At least 8 years of experience in platform, infrastructure, or DevOps engineering with end-to-end production ownership.
- Hands-on experience with API gateway technologies and preferably AI/LLM gateway patterns such as rate limiting, semantic caching, and prompt/response observability.
- Strong Kubernetes and GitOps experience across multiple environments.
- Solid CI/CD experience, including Jenkins pipeline administration, build infrastructure, and runner or agent fleet management.
- Experience with artifact and package management systems and source control platform administration.
- Working knowledge of Terraform and AWS/EKS.
- Experience operating self-hosted LLM inference stacks and GPU-backed infrastructure, including Kubernetes GPU scheduling and autoscaling.
- Familiarity with LLMOps, model versioning, evaluation harnesses, and usage or cost observability.
- Experience setting technical direction, driving cross-team initiatives, and mentoring engineers in a high-scope role.
- Clear communication skills for explaining infrastructure trade-offs to technical and non-technical stakeholders.
- Preferred experience operating enterprise AI-assisted developer tooling such as Claude Code or Copilot.
- Preferred familiarity with Okta/OIDC and enterprise authentication patterns.
- Preferred experience with LinearB, Qodo, vector databases, RAG pipelines, and production model fine-tuning or lightweight training using LoRA/QLoRA or similar.
Benefits
- Restricted Stock Units and Employee Stock Purchase Plan.
- Flexible time off, paid holidays, paid sick time, gender-neutral parental leave, and grandparent leave.
- Medical, dental, vision, life, disability, FSA, retirement plan with company match, and other insurance benefits.
- Employee Assistance Program, prepaid legal, pet insurance, cancer care, and global business travel medical insurance.
- Home office allowance and mobile phone reimbursement.
- Wellness coach, wellness or gym reimbursement, fertility coverage, and adoption or surrogacy reimbursement.
- U.S. role with a location-dependent base salary range provided in the posting.
Tech Stack
Categories
About SentinelOne
SentinelOne builds an AI-driven cybersecurity platform that provides endpoint protection, detection and response, XDR, cloud, and identity security for enterprises. Its Singularity platform is sold as subscription software and managed services to secure laptops, servers, containers, and cloud workloads with automated detection and remediation. Founded in 2013 and headquartered in Mountain View, California, SentinelOne is a public company listed on the NYSE following its 2021 IPO.