Research Engineer, Post-Training Inference
Together AIabout 2 hours ago
Base Salary
$200k - $290k/yr
Responsibilities
- Design and build systems for customizing open-source models.
- Integrate Model Shaping and Inference platforms for seamless production workloads.
- Add features to inference engines for large-scale post-training experiments.
- Ensure service stability and participate in on-call rotation for 24/7 platform availability.
Requirements
- 2+ years of experience in building and deploying machine learning services in production.
- Hands-on experience with modern inference engines like SGLang, vLLM, and TensorRT-LLM.
- Familiarity with fine-tuning methods for LLMs and AI models.
- Strong software engineering skills in Python or Go.
- Up-to-date knowledge of advances in the machine learning community.
Benefits
- Competitive compensation and startup equity.
- Health insurance and other benefits.