3 months ago
Remote, United States or Remote, CanadaSenior
Base Salary
$180k - $324k/yr
Responsibilities
- Design and evolve MAX’s developer-facing API surface, including abstractions, extension points, programming models, and compatibility guarantees.
- Design inference APIs for model loading, distributed inference, quantization, tokenization, batching, streaming, and deployment.
- Design training APIs supporting single-device through distributed execution, device placement, parallelism, checkpointing, and observability.
- Align programming conventions across Python and Mojo-adjacent surfaces.
- Write and socialize RFCs and technical specifications while incorporating feedback from internal and external users.
- Partner with compiler/runtime, kernels, cloud/serving, documentation, and DevRel teams.
- Build reference implementations, exemplar code, architecture templates, and best-practice patterns.
- Define API quality standards covering versioning, deprecation, testing, and documentation.
Requirements
- Significant experience designing and evolving developer-facing APIs for SDKs, frameworks, or platforms.
- Strong understanding of modern AI framework design tradeoffs, including PyTorch, JAX, TensorFlow, vLLM, and XLA/MLIR-adjacent ecosystems.
- Experience with inference and training systems, including execution graphs, compilation, runtime scheduling, distributed execution, checkpointing, and performance tuning.
- Fluency in one or more systems or performance languages such as C++, Rust, or Go.
- Fluency in one or more user-facing languages such as Python; familiarity with Mojo is a plus.
- Strong API design and ergonomics judgment covering naming, composability, types, error handling, configurability, and clarity.
- Strong written communication and the ability to produce implementable technical specifications.
- High engineering standards and a pragmatic approach to incremental development and long-term design.
Benefits
- Comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities may be included, with packages varying by location.
- RSU grants, annual target bonus, equity, and other compensation components are offered; compensation details are excluded from the salary fields except for base salary.
- Office-based or remote work is available for candidates in the US or Canada; new-hire onboarding is conducted in person in Los Altos, California.
- Regular team onsites and local meetups are held, and travel two to four times per year is expected for all roles.
About Modular
Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.