Modular

Senior Engineer, Hardware Enablement

Modular
Apply
8 months ago
Remote, United States +2 moreSenior

Base Salary

$148k - $222k/yr

Responsibilities

  • Bring up and validate new hardware architectures across kernels, compiler infrastructure, runtime, graph execution, and model serving.
  • Write, port, and optimize Mojo kernels for novel accelerator architectures.
  • Investigate correctness and performance issues involving kernel execution, memory movement, compiler lowering, graph decisions, synchronization, and vendor runtimes.
  • Develop expertise in accelerator ISAs, execution models, memory hierarchies, synchronization mechanisms, compiler constraints, and vendor toolchains.
  • Map AI operators and workloads such as matrix multiplication, convolution, and reductions onto new architectures.
  • Build portability infrastructure, compiler integrations, tooling, testing, debugging workflows, and integration tests for additional hardware platforms.
  • Collaborate with hardware vendors and benchmark and profile workloads to move platforms toward production-quality performance.
  • Document emerging architectures through technical documentation, demos, design discussions, and engineering write-ups.

Requirements

  • 5+ years of experience in high-performance computing, compiler engineering, accelerator software, systems engineering, or a related field.
  • Strong C++ skills and experience with complex, multi-component software systems.
  • Hands-on experience with a heterogeneous programming model such as CUDA, SYCL, OpenCL, or a comparable accelerator environment.
  • Experience writing or modifying GPU kernels, custom operators, accelerator code, or working with PyTorch at the C++ or systems layer.
  • Working knowledge of memory hierarchy, parallel execution, synchronization, data movement, and hardware/software performance relationships.
  • Experience debugging issues across software abstraction boundaries and reasoning systematically about correctness and performance.
  • Bachelor's degree in a relevant field plus 2+ years of software engineering or related experience, or a master's degree plus 1+ year, or a PhD, together with 1+ year of academic or work experience using a programming language.
  • Helpful qualifications include experience with DSPs, NPUs, AI ASICs, MLIR, LLVM, Triton, CUTLASS, CuTe, new accelerator bring-up, hardware vendors, hardware-specific profiling tools, graph compilers, model serving, runtime systems, and portability layers.

Benefits

  • Comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities, subject to location.
  • Remote work is available from home, with office options in Los Altos, California and Edinburgh; new-hire onboarding is conducted in person at the appropriate office.
  • Regular team onsites and local meetups are provided, with expected travel of 2–4 times per year.
  • The role includes competitive compensation, potential RSU grants, and possible annual bonus, equity, and benefits.
  • Candidates may apply from the US, Canada, and UK.

Categories

Modular

About Modular

201-500 employees

Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.

Contact me