Forward Deployment Engineer
SambaNova Systems3 months ago
Bengaluru, IndiaSenior
Responsibilities
- Embed with strategic enterprise customers to design, build, and deploy production GenAI applications on the SN40L platform and SambaStack portfolio.
- Architect and implement RAG pipelines, multi-agent systems, fine-tuning workflows, coding solutions, and other LLM-powered workflows.
- Optimize inference performance on SambaNova hardware and benchmark throughput, latency, and accuracy.
- Troubleshoot production issues end-to-end across model, software, and hardware layers.
- Translate customer needs into product requirements and engineering feedback.
- Partner with Account Executives and Solutions Engineers on technical sales strategy, engagement scoping, evaluations, and proof-of-concepts.
- Develop reusable accelerators, reference architectures, and internal playbooks.
- Present technical findings, architecture decisions, and roadmap input to customers and internal teams, and represent SambaNova at industry events.
Requirements
- At least 5 years of hands-on engineering experience with a strong record of shipping production AI/ML systems.
- Deep expertise in LLM orchestration, RAG, agentic frameworks, prompt engineering, and evaluation pipelines.
- Strong knowledge of model training, fine-tuning, inference optimization, quantization, and performance benchmarking.
- Python proficiency is required; C++ or CUDA experience is a strong plus.
- Experience deploying AI workloads on AWS, Azure, or GCP and familiarity with Kubernetes, Docker, and MLOps tooling.
- Ability to conduct technical discovery, set expectations, push back constructively, and present to executive and practitioner audiences.
- Bachelor's or graduate degree in Computer Science, Electrical Engineering, Mathematics, Physics, or equivalent practical experience.
- Experience with AI accelerators or custom silicon, CUDA or low-level GPU programming, VLLM or SGLang, or enterprise AI deployments in regulated industries is a bonus.
- Willingness to travel up to 50% to customer sites.
Benefits
- Competitive total rewards package including equity and benefits for US-based full-time employment positions.
- Employer covers 95% of employee medical insurance premiums and 77% of dependent premiums, with an employer-contributed Health Savings Account.
- Dental, vision, short- and long-term disability, basic life, voluntary life, AD&D, and Flexible Spending Account options are offered.
- Well-being benefits include Headspace, Gympass+, One Medical, counseling services, and an Employee Assistance Program.
Categories
Forward Deployed
About SambaNova Systems
SambaNova Systems builds full-stack AI infrastructure—custom accelerator chips, systems, and foundation models—delivered as on-prem appliances and cloud APIs for enterprises, governments, and data centers. Its offerings include the SambaNova Suite, Samba Cloud, and on-prem SambaStack, powered by its Reconfigurable Dataflow Unit (RDU) architecture, including the SN40L chip. Founded in 2017 and headquartered in San Jose, California, the company is privately held.