1 month ago
Remote, United StatesSenior
Base Salary
$148k - $270k/yr
Responsibilities
- Lead cross-team, architecture-level decisions involving concurrency, data movement, and system boundaries across an in-house software stack spanning hardware to cloud.
- Develop flexible and extensible interfaces for open-source model developers and community contributors.
- Design modular systems with clear contracts, unambiguous ownership, testability, and scaffolding for robust agentic development.
- Own software solutions from implementation through production support.
- Diagnose pathological performance bottlenecks in complex systems and translate findings into concrete solutions.
Requirements
- 5+ years of systems programming experience focused on performance, concurrency, and distributed architectures.
- Strong API and abstraction design skills, including the ability to present and defend design proposals.
- Comfort working in Python, Rust, Mojo, or similar programming languages.
- Ability to reason about complex-system performance bottlenecks and develop diagnostics and solutions.
- Demonstrated ownership of software through implementation and production support, including defensive engineering practices.
- Genuine interest in research literature and sound judgment about what is worth building.
- Helpful experience with high-performance ML inference systems such as vLLM, SGLang, or TRT-LLM.
- Helpful broad systems programming experience including lock-free and wait-free data structures, POSIX APIs, memory-layout-aware optimization, NUMA-aware design, and zero-copy transport.
- Helpful experience with graph-based programming models and runtimes, including dataflow or actor models.
- Helpful GPU or accelerator programming experience, especially asynchronous scheduling and data-transfer optimization.
Benefits
- Benefits may include healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities.
- Compensation may include RSU grants, annual target bonus, equity, and benefits.
- Regular team onsites and local meetups are provided.
- United States-based candidates are eligible; earlier-career staff work hybrid from Los Altos, CA, while more senior staff may work from the Los Altos office or remotely.
- New-hire onboarding is conducted in person in the Los Altos, CA office.
- Travel to team onsites and local meetups 2–4 times per year is expected.
Categories
About Modular
Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.