3 months ago
Los Altos, CA, USAEntry Level
Base Salary
$120k - $222k/yr
Responsibilities
- Develop the MAX API surface, including namespaces, abstractions, extension points, programming models, compatibility guarantees, and developer experience.
- Design inference APIs for model loading, distributed inference, quantization, tokenization and pipelines, configuration, batching, streaming, and deployment.
- Develop training APIs for single-device and distributed execution with primitives for device placement, parallelism, checkpointing, and observability.
- Align programming models, naming, types, and conventions across Python and Mojo-adjacent surfaces.
- Write and socialize technical RFCs and specifications, gather feedback, and iterate toward consensus.
- Partner with compiler/runtime, kernels, cloud/serving, and documentation/DevRel teams.
- Develop reference implementations, golden-path examples, architecture templates, and best-practice patterns.
Requirements
- Bachelor's degree in a listed engineering, information systems, computer science, or related field plus 2+ years of software engineering or related experience; or a master's degree plus 1+ year of such experience; or a PhD in a listed or related field.
- At least 1 year of academic or work experience with a programming language such as Python, Mojo, Rust, or C++.
- Understanding of modern AI framework design tradeoffs, including frameworks and ecosystems such as PyTorch, JAX, TensorFlow, vLLM, XLA, and MLIR.
- Proficiency in one or more systems or performance languages such as C++, Rust, or Go, and one or more user-facing languages such as Python.
- Experience or strong interest in designing developer-facing APIs, SDKs, frameworks, or platforms.
- Strong API ergonomics instincts and written communication skills for producing clear, implementable specifications.
- Familiarity with Mojo is a plus.
Benefits
- Benefits may include healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities.
- Competitive compensation may include RSU grants, annual target bonus, equity, and benefits.
- Regular team onsites and local meetups are organized, with expected travel two to four times per year.
- The role is based at the Los Altos, California headquarters and requires a minimum of three days per week onsite.
- Relocation assistance is provided for out-of-state candidates based in the US.
About Modular
Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.