Senior Performance Engineer
Samsung Semiconductor5 days ago
San Jose, CA, USASenior
Base Salary
$138k - $206k/yr
Responsibilities
- Build and operate agentic workflows, distributed inference systems, disaggregated serving architectures, and Mixture-of-Experts deployments.
- Collect workload traces, telemetry, and performance data from real-world AI applications.
- Develop representative benchmarks, characterize workload behavior, and identify bottlenecks across compute, memory, communication, and scheduling resources.
- Evaluate AI systems across the hardware and software stack, including runtimes, memory hierarchy, interconnects, and accelerator architectures.
- Collaborate with hardware and software teams on performance analysis, architecture exploration, and hardware–software co-design.
Requirements
- MS or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field, or a B.S. with 5+ years of relevant experience.
- MS candidates should have 3+ years of relevant working experience; PhD candidates may have 0+ years of relevant experience.
- Strong understanding of LLM inference and training systems.
- Strong understanding of NVIDIA GPU architecture, compute, memory hierarchy, communication, and system-level bottlenecks.
- Hands-on experience profiling and optimizing AI workloads on NVIDIA GPU platforms using Nsight Systems, Nsight Compute, or related performance analysis frameworks.
- Experience analyzing large-scale distributed AI workloads.
- Proficiency in Python and C++.
- Experience with one or more of PyTorch, vLLM, SGLang, TensorRT-LLM, DeepSpeed, Ray, or Megatron-LM.
- Strong analytical and problem-solving skills.
Benefits
- Base pay range of $138,000–$206,000 USD, plus incentive opportunities.
- Medical, dental, vision, and 401(k) benefits.
- 4+ weeks of paid time off annually, plus holidays and sick leave.
- Charitable giving match and community involvement opportunities.
- Fertility-care or adoption stipend, medical travel support, and virtual veterinary care.
- Mental wellness apps and free confidential therapy sessions.
- Onsite café, gym, and virtual fitness classes.
- Flexible work environment with daily onsite presence at the San Jose, California office.