Forward Deployment Engineer
SambaNova Systems2 hours ago
Tokyo, JapanSenior
Responsibilities
- Embed with strategic enterprise customers to design, build, and deploy production GenAI applications on the SN40L platform and SambaStack.
- Architect LLM-powered workflows including RAG pipelines, multi-agent systems, fine-tuning workflows, and coding solutions.
- Optimize inference performance and benchmark throughput, latency, and accuracy against customer and competitor requirements.
- Troubleshoot production issues across model, software, and hardware layers and serve as a technical escalation point.
- Translate customer needs into product requirements and engineering feedback.
- Partner with Account Executives and Solutions Engineers on technical sales strategy, evaluations, and proof-of-concepts.
- Create reusable accelerators, reference architectures, and internal playbooks.
- Present technical findings and roadmap input to customers, executives, internal teams, and industry audiences.
Requirements
- At least 5 years of hands-on engineering experience and a strong record of shipping production AI/ML systems.
- Deep expertise in GenAI application development, including LLM orchestration, RAG, agentic frameworks, prompt engineering, and evaluation pipelines.
- Strong foundations in model training, fine-tuning, inference optimization, quantization, and performance benchmarking.
- Proficiency in Python; C++ or CUDA experience is a strong plus for hardware-layer debugging.
- Experience deploying AI workloads on AWS, Azure, or GCP and familiarity with Kubernetes, Docker, and MLOps tooling.
- Ability to conduct technical discovery, manage expectations, challenge constructively, and present to executive and practitioner audiences.
- Bachelor's or graduate degree in Computer Science, Electrical Engineering, Mathematics, Physics, or equivalent practical experience.
- Willingness to travel up to 50% to customer sites.
- Bonus: experience with AI accelerators or custom silicon, CUDA or low-level GPU programming, vLLM or SGLang, and enterprise AI deployments in regulated industries.
Benefits
- Base salary range of ¥10,500,000—¥13,000,000 JPY.
- US-based full-time benefits include employer coverage for employee and dependent medical premiums, an HSA with employer contribution, dental, vision, disability, life, AD&D, and flexible spending account options.
- Well-being benefits include Headspace, Gympass+, One Medical, counseling services, and an Employee Assistance Program.
- The role requires travel of up to 50% to customer sites, depending on engagement needs.
Categories
Forward Deployed
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.