Senior Systems Engineer, Workers AI
Cloudflare2 days ago
Remote, Worldwide
Senior
H1B Sponsor
Responsibilities
- Develop and maintain core components of the serverless inference platform.
- Optimize the model scheduling system for efficiency and resource utilization.
- Implement improvements to inference request routing logic.
- Drive improvements in platform reliability and resilience.
- Expand and refine the observability stack for proactive issue resolution.
- Lead complex, cross-functional technical projects from concept to deployment.
- Mentor junior engineers and contribute to a collaborative engineering culture.
Requirements
- Experience in systems engineering focused on distributed, high-performance systems.
- Expert proficiency in Rust programming, especially in asynchronous environments.
- Deep understanding of networking and application protocols like TCP, HTTP, and WebSocket.
- Experience with scaling and performance optimization techniques in distributed environments.
- Demonstrable experience with container orchestration platforms like Kubernetes is a plus.
- Familiarity with large-scale inference serving architectures is a plus.
Tech Stack
KubernetesRust
Categories
AI & MLBackendDevOps