Senior Staff Engineer, AI Software
Samsung Semiconductor5 days ago
San Jose, CA, USAStaff+
Base Salary
$189k - $301k/yr
Responsibilities
- Lead software–hardware co-design of solutions that optimize AI model inference performance and address memory bottlenecks.
- Analyze, profile, and characterize LLM and agentic AI workloads across the software stack to guide hardware-aware acceleration and architectural decisions.
- Collaborate with hardware teams on memory architecture, acceleration strategies, compute placement, HBM, and memory-centric computing.
- Develop, optimize, and benchmark AI inference and serving solutions using PyTorch and vLLM.
- Define best practices and provide technical mentorship for software–hardware co-design efforts.
Requirements
- Bachelor’s degree with 15+ years, Master’s degree with 13+ years, or PhD with 10+ years of industry experience.
- Strong experience developing high-performance AI framework software for GPUs or other accelerators.
- End-to-end understanding of the AI infrastructure and software stack from model definition through deployment and serving.
- Strong understanding of LLM architectures and workflows, including modern transformer-based designs, plus solid understanding of agentic AI architectures and workflows.
- Hands-on expertise with PyTorch and practical experience with vLLM for high-throughput inference and serving.
- Strong understanding of the memory wall problem, HBM, memory architecture, and memory-centric acceleration and compute approaches.
- Proficiency in a Linux development environment and development tools including agentic coding, GitHub, and Jira.
Benefits
- Daily onsite work at the San Jose, California office under the company’s Flexible Work policy.
- Medical, dental, vision, and 401(k) benefits with an inclusive rewards plan.
- 4+ weeks of paid time off annually, plus holidays and sick leave.
- Charitable giving match, fertility or adoption support, medical travel support, and virtual veterinary care.
- Onsite café and gym, virtual fitness classes, emotional wellness apps, and confidential therapy sessions.
- Flexible work environment and incentive opportunities based on individual and company performance.
Categories