Machine Learning Engineer - New Grad
SambaNova Systems2 days ago
Base Salary
$131k - $197k/yr
Responsibilities
- Train, evaluate, and tune speculative decoding models, including Dspark/Dflash, Medusa/Eagle-style heads, and multi-token prediction.
- Develop and implement quantization, sparsity, distillation, pruning, and parameter-efficient fine-tuning techniques while measuring model quality, latency, and resource efficiency trade-offs.
- Build and evaluate agentic systems for tool calling, multi-step planning, retrieval, and long-context reasoning.
- Design rigorous evaluations and benchmarks and validate accuracy and quality claims.
- Translate recent research into working implementations and run ablation studies.
- Partner with AI performance, compiler, runtime, and product teams to ship model improvements.
- Contribute to reinforcement learning, post-training, and reward modeling work.
Requirements
- Bachelor of Science in Computer Science, Electrical Engineering, Mathematics, or a related field.
- Strong Python programming skills.
- Strong foundation in machine learning, linear algebra, probability, and numerical computing.
- Hands-on experience with PyTorch, TensorFlow, or JAX.
- Working knowledge of transformer architectures and LLM training or inference pipelines.
- Ability to design clean experiments, interpret results honestly, and communicate findings clearly.
- Preferred qualifications include an M.S. or Ph.D., research or internship experience in LLM training, post-training, or inference, and experience with model-efficiency techniques or agentic systems.
- Preferred qualifications include familiarity with reinforcement learning or preference optimization, distributed training or inference frameworks, and publications or meaningful open-source contributions.
Benefits
- Base salary range of $131,200–$196,800 USD, plus equity and benefits.
- SambaNova covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer-contributed Health Savings Account.
- Dental, vision, short- and long-term disability, basic and voluntary life, AD&D, and flexible spending account options are offered.
- Well-being benefits include Headspace, Gympass+ membership, One Medical membership, counseling services, and an Employee Assistance Program.
- Benefits listed apply to US-based, full-time employment positions.
Categories
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.