Staff Software Engineer AI/ML
Samsung Semiconductor5 days ago
San Jose, CA, USAStaff+
Base Salary
$163k - $253k/yr
Responsibilities
- Design, build, productize, deploy, and operate agentic AI applications combining vision and language models.
- Architect multi-agent systems with orchestration, tool and function routing, state and memory management, error recovery, and human-in-the-loop workflows.
- Establish evaluation frameworks, quality metrics, benchmark suites, regression harnesses, and offline and online evaluation for agentic and multimodal systems.
- Make data-driven decisions about models, routing strategies, inference configurations, quality, cost, latency, compute, and memory budgets.
- Optimize inference on accelerated hardware through quantization, batching, caching, kernel and runtime tuning, profiling, and model/hardware co-design.
- Solve AI acceleration problems involving memory bottlenecks, algorithms, network design, and hardware architecture.
- Collaborate with researchers and application developers to optimize the performance of machine learning systems.
Requirements
- BS with 10+ years, MS with 8+ years, or PhD with 5+ years of experience in Computer Science, Electrical Engineering, or a related field.
- Production experience deploying and operating LLM- or vision-powered systems, including evaluation, safe rollouts, quality metrics, benchmarking, and quality/cost/latency trade-offs.
- Hands-on experience with agentic AI frameworks such as LangGraph, CrewAI, and ADK, including multi-agent orchestration, tool routing, state management, MCP, or A2A.
- Experience with LLM inference optimization and serving using technologies such as vLLM and TensorRT-LLM, including quantization, KV-cache management, and hardware-aware deployment.
- Strong Python and C/C++ skills, deep experience with PyTorch or TensorFlow, and experience designing, building, and securing large-scale distributed systems.
- Preferred qualifications include a PhD or software engineering experience, MLOps exposure, experience with ML, graphics, or computer vision accelerators, and knowledge of PPA, memory controller architecture, computer architecture, AI workloads, and heterogeneous-system performance modeling.
- Ability to meet aggressive project deadlines in a team environment.
Benefits
- Medical, dental, vision, and 401(k) benefits.
- Charitable giving match and community involvement opportunities.
- 4+ weeks of paid time off annually, plus holidays and sick leave.
- Family-support benefits including fertility or adoption support, medical travel support, and virtual veterinary care.
- Emotional wellness apps and free confidential therapy sessions.
- Onsite café, gym, and virtual fitness classes.
- Flexible work environment.
Categories