Software Engineer
Tenstorrent9 months ago
Tokyo, JapanMid Level
H1B Sponsor
Responsibilities
- Develop tt-metal and implement DNN models in ttnn and tt-transformers.
- Analyze and optimize DNN model performance.
- Improve DNN model accuracy.
Requirements
- Experience launching current ML models on new hardware platforms.
- Ability to analyze performance bottlenecks, tune architectures, and improve model accuracy and robustness.
- Understanding and implementation experience with DNN optimization techniques such as quantization, sparsity, and attention optimization.
- Understanding of hardware characteristics including matrix/SIMD compute engines and memory caches.
- Ability to follow current ML research and translate it into practical improvements.
- Fluent English communication with development teams.
- Experience with NVIDIA GPUs such as H100 and A100, AMD Instinct, or Habana Gaudi is preferred.
- Experience tuning and optimizing large-scale AI workloads is preferred.
- DNN profiling and optimization experience and C++ performance-tuning experience are preferred.
- Knowledge of HPC clusters and distributed processing technologies such as MPI and NCCL is preferred.
- Experience implementing cluster-management software such as Slurm or Kubernetes is preferred.
- Open-source project participation or contribution experience is preferred.
- Applicant must be eligible to access U.S. export-controlled technology or obtain applicable license approval.
Benefits
- On-site role based in Tokyo, Japan.
Tech Stack
Categories
About Tenstorrent
Tenstorrent is a next-generation computing company that builds computers for AI. Headquartered in the U.S. with offices in Austin, Texas, and Silicon Valley, and global offices in Toronto, Belgrade, Seoul, Tokyo, and Bangalore, Tenstorrent brings together experts in the field of computer architecture, ASIC design, RISC-V technology, advanced systems, and neural network compilers. Tenstorrent is backed by Eclipse Ventures and Real Ventures, Archerman Capital, Samsung Catalyst Fund, and Hyundai Motor Group among others. Join us: www.tenstorrent.com/careers.