13 days ago
Palo Alto, CA, USAMid Level / Senior / Staff+
H1B Sponsor
Base Salary
$180k - $440k/yr
Responsibilities
- Design, build, and optimize large-scale distributed systems for multimodal pre-training and post-training.
- Develop high-throughput pipelines for data acquisition and processing across various modalities.
- Advance multimodal capabilities including reasoning and real-time processing.
- Drive data quality initiatives and scalable pipelines for large models.
- Create evaluation frameworks and metrics for real-world usage.
- Innovate on algorithms and scaling paradigms for performance.
- Build research tooling and user-friendly interfaces for rapid iteration.
Requirements
- Hands-on experience with multimodal pre-training or fine-tuning.
- Expert-level proficiency in Python and experience with JAX/PyTorch/XLA.
- Proven track record in building large-scale distributed ML systems.
- Deep experience in designing and running data pipelines at scale.
- Strong fundamentals in evaluation design and reward modeling.
- Proactive self-starter thriving in high-intensity environments.
- Willingness to own end-to-end initiatives for user experience.
Benefits
- Equity in the company.
- Comprehensive medical, vision, and dental coverage.
- Access to a 401(k) retirement plan.
- Short and long-term disability insurance.
- Life insurance and various discounts and perks.