Senior Systems Engineer, Workers AI
Cloudflare2 months ago
London, United KingdomSenior
Responsibilities
- Develop and maintain highly available, scalable components of the serverless inference platform.
- Optimize model scheduling, resource utilization, request routing, and latency across distributed inference infrastructure.
- Improve platform reliability and resilience by identifying and mitigating systemic risks.
- Expand metrics, logging, tracing, and alerting capabilities to identify and resolve production issues proactively.
- Lead cross-functional technical projects from initial concept and design through deployment and operationalization.
- Mentor junior engineers and contribute to a collaborative engineering culture.
Requirements
- Proven systems engineering experience focused on distributed, high-performance systems.
- Expert proficiency in Rust, particularly in asynchronous environments.
- Hands-on experience with networking and application protocols such as TCP, HTTP, and WebSocket.
- Experience with scaling and performance optimization techniques, including distributed load balancing and caching.
- Experience with Kubernetes and/or Nomad is desirable.
- Familiarity with large-scale inference serving for LLMs and diffusion models is desirable.
Benefits
- Hybrid work arrangement in Austin, Texas, or London, UK.
- Applicants who reach the offer stage may be asked to attend an in-person interview at a Cloudflare office or hub.
- Cloudflare offers equal employment opportunity and reasonable accommodations for qualified individuals with disabilities.
Tech Stack
Categories
About Cloudflare
Cloudflare builds a global network that provides CDN, DDoS mitigation, DNS, Zero Trust security, and developer/edge computing tools for organizations of all sizes. It sells subscriptions to its cloud-based platform and usage-based services that protect and accelerate web sites, APIs, and corporate networks, plus serverless apps via Workers. Founded in 2009 and headquartered in San Francisco, it is a public company traded on the NYSE (ticker: NET).