Modular

Staff AI Inference Tools Engineer

Modular
Apply
1 day ago
Remote, United KingdomStaff+

Responsibilities

  • Build developer tools that improve the MAX developer experience across traditional and agentic workflows.
  • Develop profiling, tracing, debugging, correctness, metrics, and dashboard technologies for AI inference deployments.
  • Create agent-native tools and workflows for bringing up models, triaging running systems, and profiling and optimizing real workloads.
  • Strengthen tooling interfaces between MAX, Mojo, driver APIs, and higher-level orchestration layers.
  • Participate in design discussions and code reviews and maintain high engineering standards.
  • Work with kernel, model, and serving engineers to identify pain points and improve their productivity.

Requirements

  • Relevant bachelor’s degree with 4+ years of software engineering or related experience, or a relevant master’s degree with 3+ years, or a relevant PhD with 2+ years.
  • At least 2 years of work experience with programming languages such as Python, Mojo, Rust, or C++.
  • Experience designing, building, and shipping developer tools, developer infrastructure, or observability systems.
  • Fluency in one or more systems or performance languages such as C++, Rust, or Go and one or more user-facing languages such as Python.
  • Experience measuring software performance through profiling, tracing, or benchmarking and analyzing the results.
  • Strong written communication, ability to work independently in a distributed team, and a user-focused approach to developer productivity.
  • Helpful qualifications include GPU performance tooling or programming experience, familiarity with PyTorch, JAX, or TensorFlow, and experience building AI-agent tooling such as agent skills or MCP.

Benefits

  • Benefits may include healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities, varying by location.
  • Competitive compensation may include RSU grants, annual target bonus, equity, and benefits.
  • UK candidates may work remotely from home or from the Edinburgh office; onboarding for new hires is conducted in person in Edinburgh.
  • Travel to team onsites and local meetups two to four times per year is expected.
  • The company offers team building events, learning and development opportunities, and a collaborative engineering environment.

Tech Stack

Categories

Modular

About Modular

201-500 employees

Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.

Contact me