Software Engineer, Networking - Inference
OpenAI
4 months ago
San Francisco, CA, USA
Senior
Base Salary
$325k - $490k/yr
Responsibilities
- Architect and build the network load balancer for research jobs.
- Design traffic stickiness and routing strategies for reliability and throughput.
- Instrument and debug complex distributed systems with observability tools.
- Collaborate with researchers and ML engineers on infrastructure decisions.
- Own the end-to-end system lifecycle from design to deployment and scaling.
- Contribute across layers of the stack in an outcome-oriented environment.
Requirements
- Deep experience designing and operating large-scale distributed systems.
- 5+ years of experience in software engineering and systems architecture.
- Strong debugging skills with a focus on distributed failures.
- Proficiency in production code writing and reviewing in Rust or similar languages.
- Experience in big tech or high-growth environments.
- Ownership mindset for end-to-end problem-solving.
Tech Stack
AmbassadorCC++GogRPCJavaRust
Categories
AI & MLBackend