Senior Systems Engineer, Workers AI
CloudflareResponsibilities
- Develop and maintain highly available, scalable components of the serverless inference platform.
- Optimize model scheduling, resource utilization, request routing, and latency across distributed inference infrastructure.
- Improve platform reliability and resilience by identifying and mitigating systemic risks.
- Expand metrics, logging, tracing, and alerting capabilities to identify and resolve production issues proactively.
- Lead cross-functional technical projects from initial concept and design through deployment and operationalization.
- Mentor junior engineers and contribute to a collaborative engineering culture.
Requirements
- Proven systems engineering experience focused on distributed, high-performance systems.
- Expert proficiency in Rust, particularly in asynchronous environments.
- Hands-on experience with networking and application protocols such as TCP, HTTP, and WebSocket.
- Experience with scaling and performance optimization techniques, including distributed load balancing and caching.
- Experience with Kubernetes and/or Nomad is desirable.
- Familiarity with large-scale inference serving for LLMs and diffusion models is desirable.
Benefits
- Hybrid work arrangement in Austin, Texas, or London, UK.
- Applicants who reach the offer stage may be asked to attend an in-person interview at a Cloudflare office or hub.
- Cloudflare offers equal employment opportunity and reasonable accommodations for qualified individuals with disabilities.
Tech Stack
Categories
About Cloudflare
Cloudflare, Inc. (NYSE: NET) is the leading connectivity cloud company. It empowers organizations to make their employees, applications and networks faster and more secure everywhere, while reducing complexity and cost. Cloudflare’s connectivity cloud delivers the most full-featured, unified platform of cloud-native products and developer tools, so any organization can gain the control they need to work, develop, and accelerate their business. Powered by one of the world’s largest and most interconnected networks, Cloudflare blocks billions of threats online for its customers every day. It is trusted by millions of organizations – from the largest brands to entrepreneurs and small businesses to nonprofits, humanitarian groups, and governments across the globe.