Modular

AI Inference Tools Engineer

Modular
Apply
1 month ago
Remote, United StatesSenior

Base Salary

$167k - $242k/yr

Responsibilities

  • Build developer tooling that improves the MAX experience across traditional and agentic workflows.
  • Design, build, and maintain profiling, tracing, debugging, correctness, metrics, and dashboard technologies for the MAX framework.
  • Create agent-native tools and workflows for bringing up models, triaging systems, profiling, and optimizing workloads.
  • Connect MAX tooling with Mojo, driver APIs, and higher-level orchestration layers.
  • Participate in design discussions and code reviews.
  • Work with kernel, model, and serving engineers to identify pain points and improve developer productivity.

Requirements

  • Experience designing, building, and shipping developer tools, developer infrastructure, or observability systems used by other engineers.
  • Fluency in one or more systems/performance languages such as C++, Rust, or Go, and one or more user-facing languages such as Python.
  • Experience measuring software performance through profiling, tracing, or benchmarking, with the systems knowledge to analyze results.
  • Strong written communication, independence, and a user-focused approach to developer experience.
  • GPU performance tooling experience with tools such as Nsight Systems, Nsight Compute, rocprof, or Perfetto is helpful but not required.
  • GPU programming experience with CUDA or ROCm is helpful but not required.
  • Knowledge of AI implementation and modeling techniques and familiarity with PyTorch, JAX, or TensorFlow is helpful but not required.
  • Experience building tooling for AI agents, including agent skills or MCP, is helpful but not required.

Benefits

  • Candidates may be based in the US, Canada, or UK; earlier-career employees work hybrid at the Los Altos or Edinburgh offices at least three days per week, while senior members may work in-office or remotely.
  • Relocation assistance is provided for eligible out-of-state US candidates, and onboarding is conducted in person at an appropriate office.
  • Benefits may include healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support, and learning and development opportunities.
  • The company organizes team onsites and local meetups, with expected travel two to four times per year.
  • Compensation may include RSU grants, annual target bonus, equity, and benefits.

Tech Stack

Categories

Modular

About Modular

201-500 employees

Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.

Contact me