6 months ago
Cupertino, CA, USAMid Level / Senior
Responsibilities
- Propose and conduct novel research to achieve results on Sohu that are unviable on GPUs.
- Translate core mathematical operations from popular Transformer-based models into performant instruction sequences for Sohu.
- Develop deep architectural knowledge to inform software performance on Sohu hardware.
- Co-design and finetune emerging model architectures for efficiency on Sohu.
- Guide and contribute to the Sohu software stack and performance characterization tools using Python and Rust.
Requirements
- An ML Research background with interests in hardware co-design.
- Experience with Python, Pytorch, and/or JAX.
- Familiarity with transformer model architectures and inference serving stacks.
- Experience working cross-functionally in diverse software and hardware organizations.
Benefits
- Full medical, dental, and vision packages, with 100% of premium covered.
- Housing subsidy of $2,000/month for those living within walking distance of the office.
- Daily lunch and dinner in the office.
- Relocation support for those moving to Cupertino.
Categories
AI ResearchML Engineering
About Etched
Etched designs and sells AI inference chips and servers that hard‑code support for specific model architectures. Its first ASIC, Sohu, targets transformer models to deliver high‑throughput, low‑latency inference for workloads such as real‑time generation. Founded in 2022 and headquartered in San Jose, California, the privately held company serves organizations building large‑scale AI inference clusters and infrastructure.