about 4 hours ago
Remote, United StatesMid Level / Senior
H1B Sponsor
Base Salary
$144k - $192k/yr
Responsibilities
- Utilize profiling tools to identify bottlenecks in data loading and computation.
- Implement optimizations like kernel fusion and sharding to improve training speed.
- Optimize distributed training pipelines using frameworks such as PyTorch Distributed.
- Design and maintain high-performance GPU kernels in Triton or CUDA.
- Optimize robust data loading pipelines to maximize training throughput.
Requirements
- Bachelor’s, Master’s degree, or PhD in Computer Science, Computer Engineering, or a related technical discipline.
- Strong proficiency in Python.
- Extensive hands-on experience with PyTorch.
- Experience optimizing machine learning model execution during training and inference.
- Exceptional analytical and problem-solving skills.
Benefits
- Medical, dental, and vision insurance.
- 401k with a company match.
- Health savings accounts.
- Life insurance and pet insurance.
- Flexible hybrid work schedule or fully remote option.