Senior AI Performance Engineer
SambaNova Systems2 months ago
Base Salary
$180k - $255k/yr
Responsibilities
- Bring up and optimize foundation models including DeepSeek, Llama, and Qwen on the SambaNova platform.
- Profile and enhance model performance across compiler, runtime, and hardware layers to improve throughput and latency.
- Collaborate with machine learning, compiler, runtime, and hardware teams on high-performance AI applications.
- Apply advances in model architecture, quantization, scheduling, and memory optimization.
- Develop scalable, efficient end-to-end inference solutions aligned with customer needs.
- Identify bottlenecks and develop dataflow or scheduling optimizations for single-node and distributed systems.
Requirements
- Bachelor’s or higher degree in computer science, electrical engineering, applied mathematics, physics, statistics, or a related field.
- At least 3 years of experience in deep learning model development and performance optimization, compiler/runtime/kernel optimization, software-hardware co-design, or systems performance tuning.
- Proficiency in Python or C++ with strong foundations in algorithms, data structures, and numerical computing.
- Experience with at least one major ML framework, including PyTorch, TensorFlow, or JAX.
- Demonstrated ability to analyze and optimize real-world ML pipelines.
- Preferred qualifications include LLM or multimodal model training and inference, distributed training, continuous batching, high-throughput inference, quantization, graph optimization, kernel fusion, and model partitioning.
- Preferred experience includes DeepSpeed, Megatron, vLLM, TensorRT, CUDA, Triton, OpenCL, cuDNN, cuBLAS, memory hierarchy optimization, caching, scheduling, publications, or open-source contributions.
Benefits
- Base salary range of $180,000—$255,000 USD, plus equity and benefits.
- US-based full-time employees receive medical insurance with 95% employee premium coverage and 77% dependent premium coverage, plus an employer-contributed HSA.
- Benefits include dental, vision, short- and long-term disability, basic and voluntary life insurance, AD&D, and flexible spending accounts.
- Well-being benefits include Headspace, Gympass+ with physical gym access, One Medical, counseling services, and an Employee Assistance Program.
Categories
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.