5 months ago
Base Salary
$150k - $300k/yr
Responsibilities
- Build and maintain training and inference stacks optimized for fast experimentation, flexibility, and high-performance inference
- Develop benchmarks to identify bottlenecks in training and inference systems
- Evaluate state-of-the-art advances in training and inference and apply relevant techniques
- Design reliable and observable systems for multi-node, multi-GPU model training
- Scale distributed training and inference across large GPU clusters while improving utilization, reliability, and cost efficiency
- Build tooling, abstractions, and observability that help machine learning engineers move from experimentation to production
Requirements
- Strong Python skills and a background in systems engineering
- Comfort with Kubernetes and distributed training frameworks
- Ability to solve complex problems, work from first principles, and handle real-world implementation challenges
- Effective collaboration across technical and non-technical teams
- Ability to take ownership from strategy through execution
- Experience at an early-stage or high-growth startup is a bonus
- Meaningful development experience with open-source training or inference stacks is a bonus
- Interest in distributed inference across hundreds to thousands of GPUs is a bonus
Benefits
- Unlimited paid time off
- Free daily lunch at the office
- Reimbursed transportation
- Medical, dental, and vision insurance
- Up to $150 per month health and wellness reimbursement
- Parental leave
- In-person role at the company's San Francisco office
Tech Stack
Categories
About Reducto
Reducto is the complete agentic document platform for leading AI teams needing performance at enterprise scale. We provide a comprehensive toolkit for working with documents the way a human would, combining custom in-house and leading frontier models to power efficient and accurate document workflows. We currently power the best AI teams ranging from startups to Fortune 10 companies across all industries: legal, finance, healthcare, and more. We are built for enterprise workloads with flexible deployment options from the cloud to fully air-gapped environments, SOC II and HIPAA compliance, and zero data retention.