Modular
Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.
Open Positions at Modular
12 open positions
Build and mature the Mojo LLDB-based debugger for a new systems programming language designed for the AI era. You will shape interactive debugging, IDE integration, developer tooling, and the future roadmap while engaging with the open-source community.
Build and optimize high-performance attention and foundational AI kernels for GPUs, NPUs, ASICs, and other emerging accelerators. This senior IC role combines low-level kernel engineering, performance analysis, and collaboration on Modular’s Attention framework.
Build the next-generation Mojo compiler for CPUs, GPUs, and AI accelerators using MLIR and LLVM. You’ll shape language features, optimization passes, code generation, and the developer experience for a rapidly evolving programming language.
Build and optimize a high-performance AI runtime spanning CPUs, GPUs, and accelerator hardware. You’ll improve model execution efficiency, data transfer, and performance analysis while partnering with compiler, kernels, serving, infrastructure, and customer teams.
Build the distributed-systems foundations that make next-generation AI model inference faster, more composable, and reliable. This role focuses on high-performance systems programming, inference architecture, and production-grade abstractions across the stack from hardware to cloud.
Build developer tools that help engineers create, debug, profile, and optimize AI inference models and kernels across heterogeneous hardware. You’ll shape agent-native workflows and improve the MAX developer experience for Modular’s AI serving platform.
Lead the technical direction of the Mojo compiler backend, driving code generation, lowering, optimization, and support for heterogeneous hardware. This staff-level IC role also leads debugger and language-tooling efforts while mentoring compiler and tooling engineers.
Build and mature the LLDB-based debugger and developer tooling for Mojo, a new systems programming language for AI and accelerated computing. You’ll shape the debugging roadmap while working across interactive debugging, IDE integration, profiling, GPU debugging, and the Mojo developer community.
Inference Optimization Engineer building the platform, tooling, and software optimizations that deliver state-of-the-art LLM inference performance across kernels, engines, GPUs, ASICs, and cloud infrastructure. The role combines deep performance engineering with customer workload analysis and cross-functional technical leadership.
Build and optimize software support for novel accelerator architectures across kernels, compilers, runtimes, graph execution, and model serving. This cross-functional role combines low-level systems engineering, hardware bring-up, performance optimization, and collaboration with hardware vendors.
Unlock 2 More Matching Jobs
Create an account to view all jobs matching your criteria.
First to know
Discover the latest jobs before everyone else
Zero Spam
No ghost jobs, reposts, or sponsored listings
AI-powered filters
Find the most relevant jobs for you