6 months ago
Palo Alto, CA, USAMid Level
H1B sponsor
Base Salary
$200k - $450k/yr
Responsibilities
- Maintain and optimize proprietary reinforcement learning training and serving infrastructure across the full stack.
- Improve reinforcement learning throughput from data generation through model training using sharded multi-node training and inference algorithms.
- Optimize inference engines, routers, schedulers, and custom kernels for high-throughput reinforcement learning and low-latency LLM production traffic.
- Identify and resolve distributed-cluster performance bottlenecks while optimizing throughput and memory efficiency for multi-billion-parameter models.
Requirements
- Bachelor’s degree in Computer Science or a related technical field, or equivalent industry experience.
- At least 2 years of relevant hands-on industry experience.
- Proficiency in Python and experience building or maintaining components within ML frameworks such as PyTorch, JAX, or TensorFlow.
- Understanding of distributed training concepts and collective communication primitives such as NCCL, or practical experience deploying and profiling models on GPU-accelerated cloud infrastructure.
- Preferred qualifications include an MS or PhD, 5+ years of relevant experience, C++ proficiency, kernel optimization experience, scalable inference deployment, FSDP or tensor-parallel sharding on multi-node GPU clusters, and reinforcement learning systems design experience.
Benefits
- Unlimited PTO.
- 401(k) matching.
- Employer-paid health, vision, and dental benefits for employees, with 50% dependent coverage.
- Health Savings Account available for qualifying health plans.
Categories
About Harmonic
We are forging the worlds most advanced mathematical reasoning engine