5 months ago
Remote, United States or Remote, CanadaSenior
Base Salary
$180k - $324k/yr
Responsibilities
- Design and evolve MAX’s developer-facing API surface, including namespaces, abstractions, extension points, compatibility guarantees, and programming models.
- Design inference APIs for model loading, distributed inference, quantization, tokenization, batching, streaming, and deployment workflows.
- Design training APIs supporting single-device and distributed execution, device placement, parallelism, checkpointing, and observability.
- Align programming conventions, naming, and types across Python and Mojo-adjacent surfaces.
- Write and socialize RFCs and technical specifications while gathering feedback from internal engineers and external users.
- Partner with compiler/runtime, kernels, cloud/serving, and documentation/DevRel teams.
- Build reference implementations, golden-path examples, architecture templates, and best-practice patterns.
- Define API quality standards covering versioning, deprecation, testing, and documentation.
Requirements
- Significant experience designing and evolving developer-facing APIs for SDKs, frameworks, or platforms.
- Strong understanding of modern AI framework design tradeoffs, including PyTorch, JAX, TensorFlow, vLLM, and XLA/MLIR-adjacent ecosystems.
- Experience with inference and training systems, model execution graphs, compilation, runtime scheduling, distributed execution, checkpointing, and performance tuning.
- Fluency in one or more systems or performance languages such as C++, Rust, or Go.
- Fluency in one or more user-facing languages such as Python; familiarity with Mojo is preferred.
- Strong API design judgment covering naming, composability, types, error handling, configurability, and clarity.
- Strong written communication and ability to write implementable technical specifications.
- High engineering standards, pragmatism, and an incremental development mindset.
Benefits
- Comprehensive healthcare coverage may be available, along with retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities.
- The compensation package may include RSU grants, annual target bonus, equity, and benefits.
- Regular team onsites and local meetups are organized, with expected travel two to four times per year.
- Candidates may work in the Los Altos, California office or remotely from home in the US or Canada; new-hire onboarding is conducted in person in Los Altos.
- Candidates outside the listed requirements are encouraged to apply because lower- or higher-level openings may be available.
About Modular
Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.