Responsibilities
- Build and maintain MCP servers for secure interactions between LLMs, agents, enterprise tools, APIs, databases, and local resources.
- Design and deploy high-performance containerized Generative AI workloads using Docker, Kubernetes, model quantization, and KV-cache optimization.
- Lead the architecture, deployment, and evolution of production-scale Generative AI platforms and intelligent agent systems.
- Define engineering standards, architectural patterns, and best practices for robust enterprise AI systems.
- Partner across multidisciplinary teams to deliver scalable, secure, observable, and production-ready AI capabilities.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- 10+ years of software engineering experience with significant expertise in distributed systems, platform engineering, or machine learning infrastructure.
- Proven experience building, deploying, and operating production-grade AI/ML or LLM systems at scale.
- Strong Python expertise and experience with systems languages such as Go, C++, Rust, or Java.
- Hands-on experience with Docker, Kubernetes, and cloud-native deployment patterns.
- Foundational understanding of AI/ML technologies and experience leveraging, securing, or positioning AI-driven solutions.
- Preferred: experience with AI safety, evaluation benchmarks, guardrails, and LLM observability frameworks.
- Preferred: experience with RAG systems, vector databases, embedding pipelines, and retrieval tuning.
- Preferred: experience with vLLM, TensorRT-LLM, Triton, Ray Serve, or equivalent inference and serving frameworks.
Benefits
- Hybrid work arrangement.
- Various health plans.
- Vacation and sick time-off plans.
- Parental leave options.
- Retirement options.
- Education reimbursement.
- In-office perks.
Categories
About Zscaler
Zscaler (NASDAQ: ZS) is a pioneer and global leader in zero trust security. The world’s largest businesses, critical infrastructure organizations, and government agencies rely on Zscaler to secure users, branches, applications, data & devices, and to accelerate digital transformation initiatives. Distributed across 160+ data centers globally, the Zscaler Zero Trust Exchange™ platform combined with advanced AI combats billions of cyber threats and policy violations every day and unlocks productivity gains for modern enterprises by reducing costs and complexity. Stay Connected: LinkedIn: https://www.linkedin.com/company/zscaler Twitter: https://www.twitter.com/zscaler Facebook: https://www.facebook.com/Zscaler/ Instagram: https://www.instagram.com/zscalerinc/