AI Performance Engineer - New Grad
SambaNova Systems1 day ago
Base Salary
$131k - $197k/yr
Responsibilities
- Bring up new foundation models on the SambaNova platform using its software stack.
- Profile model performance across compiler, runtime, and hardware layers.
- Identify bottlenecks and propose dataflow or scheduling optimizations for single-node and distributed systems.
- Apply quantization, scheduling, and memory optimization techniques.
- Benchmark inference throughput and latency and track performance across releases.
- Collaborate with machine learning, compiler, runtime, and hardware teams to ship performance improvements.
Requirements
- Bachelor’s degree in Computer Science, Electrical Engineering, or a related field.
- Strong programming skills in Python or C++.
- Understanding of algorithms, data structures, and numerical computing.
- Experience with PyTorch, TensorFlow, or JAX.
- Experience with inference frameworks such as vLLM, TensorRT, or SGLang.
- GPU programming experience with CUDA or Triton.
- Preferred: master’s or Ph.D. in a relevant field, LLM training or inference experience, familiarity with quantization, graph optimization, kernel fusion, or model partitioning, and knowledge of memory hierarchy, caching, and scheduling.
- Preferred: internship or research experience in ML systems or performance optimization, plus publications or open-source contributions in ML systems.
Benefits
- US-based full-time employees receive medical, dental, vision, disability, life, AD&D, and flexible spending account benefits.
- The company covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer HSA contribution.
- Benefits include equity, Headspace, Gympass+, One Medical, counseling services, and an Employee Assistance Program.
Categories
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.