Staff Engineer, Compiler

5 days ago

San Jose, CA, USAStaff+

Base Salary

$163k - $253k/yr

Responsibilities

Adapt torch.compile and Inductor to custom hardware by lowering compiler IR, defining fusion and specialization behavior, and determining when to use handwritten kernels.
Build or extend tile-based and higher-level kernel DSLs, including changes to frontends, IRs, or backends when existing GPU assumptions do not apply.
Design placement and scheduling passes for distributed memory, including tensor location, migration, and overlap of computation with data movement.
Implement tensor, pipeline, expert, and sequence parallelism as first-class compiler IR capabilities.
Develop fusion, tiling, memory-planning, kernel-autotuning, and performance-optimization solutions for non-uniform memory hierarchies.
Contribute compiler and DSL improvements upstream to projects such as PyTorch, Triton, Helion, and related open-source communities.

Bachelor’s degree and 10+ years, Master’s degree and 8+ years, or PhD and 5+ years of industry experience.
3–5+ years of industry experience with at least one of Triton, Helion, MLIR, XLA, TVM, Inductor, IREE, CUTLASS, or a proprietary equivalent; more experienced candidates may be considered at relevant levels.
Experience designing a kernel DSL or IR from scratch, or making substantial language-level changes to an existing DSL or IR.
Experience writing MLIR dialects and passes or performing MLIR backend integration.
Experience building PyTorch backends for non-CUDA accelerators such as XPU, ROCm, MPS, TPU, or custom accelerators.
Experience with kernel autotuning, performance modeling, or cost-based compilation.
Background in HPC, distributed systems, or NUMA-aware programming.
Open-source contributions to PyTorch, Triton, Helion, LLVM/MLIR, or similar projects are preferred.

Daily onsite work at the San Jose, California office under a flexible work policy.
Medical, dental, vision, and 401(k) benefits.
4+ weeks of paid time off annually, plus holidays and sick leave.
Charitable giving match and community involvement opportunities.
Fertility-care or adoption stipend, medical travel support, and virtual veterinary care.
On-demand wellness apps and free confidential therapy sessions.
Onsite café and gym plus virtual fitness classes.
Flexible work environment and other wellbeing-focused rewards.

10,000+ employees