18 hours ago
Shanghai, ChinaStaff+
Responsibilities
- Architect, develop, and manage Kubernetes clusters and enterprise AI platform layers throughout their full lifecycle.
- Build and operate MLOps and LLMOps platforms integrating model lifecycle, feature store, model registry, AutoML, pipelines, model serving, fine-tuning, and inference capabilities.
- Design AI gateways, governance frameworks, FinOps controls, guardrails, and integrations with cloud and MAAS ecosystems.
- Develop scalable AI and agentic applications using LangChain, LangGraph, backend APIs, WebUIs, SDKs, CLIs, and applications.
- Design backend systems using REST, gRPC, GraphQL, SQL, NoSQL, Kafka, RabbitMQ, caching, and distributed architectural patterns.
- Lead platform engineering, observability, SRE practices, cloud-native reusability, high availability, disaster recovery, security compliance, and enterprise integration.
- Evaluate AI hardware, storage, data center networks, RDMA environments, Linux systems, NVIDIA toolchains, and private cloud infrastructure.
- Automate infrastructure and security hardening using Terraform, CloudFormation, Ansible, Packer, and related tooling.
- Lead large-scale projects and Agile delivery, including backlog management, WBS decomposition, CI/CD coordination, governance, and compliance processes.
- Author architecture and validation documentation, maintain technical knowledge bases, collaborate across global and local teams, and mentor engineers.
Requirements
- 10+ years of experience as a Solution Architect, including at least 2+ years of hands-on AI Architecture or AI Platform design experience.
- Fluent English and Mandarin communication skills for high-level discussions with global and local technical teams.
- Deep expertise in Kubernetes, MLOps, LLMOps, model serving, feature stores, SFT, RAG, AI gateways, and distributed systems.
- Experience with large-model fine-tuning and inference frameworks such as DeepSpeed, vLLM, SGLang, and TorchTune, plus expertise in Ray.
- Hands-on experience developing agentic applications with LangChain and LangGraph and working with vector and graph databases.
- Strong experience with high availability, disaster recovery, RBAC, SSO, LDAP, bastion hosts, security compliance, and FinOps governance.
- Strong cloud-native and CNCF ecosystem knowledge, including observability tools and platforms such as AWS, Alibaba Cloud, Prometheus, Grafana, OpenTelemetry, and ELK.
- Extensive hands-on experience with Terraform, Ansible, Packer, CloudFormation, GitLab CI/CD, and JFrog.
- Mastery of at least one backend language such as Python or Go.
- Experience with GPUs, high-performance CPUs, NAS/SAN storage, performance benchmarking, RDMA networking, Linux, RHEL/CentOS, and NVIDIA driver toolchains.
- High proficiency in Scrum and Agile development processes and tools.
- Demonstrated success leading large-scale AI platforms or projects and mentoring cross-functional teams; pharmaceutical, life sciences, GxP, or top-tier technology experience is preferred.
Benefits
- Roche offers an inclusive, equal-opportunity culture that values personal expression, open dialogue, and collaboration.
- The role is based in Roche China and involves collaboration across global and local teams.
- The position offers the opportunity to build healthcare AI platforms intended to support life-changing solutions and broad patient impact.
Tech Stack
AnsibleApache KafkaCloudflareDatabricksGitGoGrafanaGraphQLgRPCKubernetesLinuxMLflowPrometheusPythonRabbitMQSQLTerraform
Categories
About Roche
Roche is a Swiss healthcare company that develops and sells prescription pharmaceuticals and in vitro diagnostic systems for hospitals, laboratories, and clinicians. Its business spans two core divisions—Pharmaceuticals and Diagnostics—with strengths in oncology, immunology, neuroscience, infectious diseases, and diabetes care. Founded in 1896 and headquartered in Basel, Switzerland, Roche also advances personalized healthcare by pairing therapies with companion diagnostics.