12 months ago
Remote, United States or Remote, CanadaSenior
Base Salary
$180k - $270k/yr
Responsibilities
- Build the multi-cloud, multi-tenant platform powering Modular’s inference services.
- Develop fault-tolerant, low-toil services that use resources across major cloud providers, neoclouds, and varied hardware platforms.
- Improve operational excellence through request-to-kernel observability, multi-cloud deployments, and cold-start optimization.
- Build Helm charts, Kubernetes operators, and maintainable deployment systems.
- Operate high-performance, observable distributed services for large-scale machine-learning inference.
Requirements
- At least 5 years of backend engineering experience.
- Experience with service-oriented architecture and distributed systems.
- Experience with AWS, GCP, Azure, and other cloud providers or neoclouds.
- Experience with Kubernetes and operating production services.
- Experience with machine-learning technologies and use cases.
- A bachelor's degree plus 4+ years, master's degree plus 3+ years, or PhD plus 2+ years of relevant software engineering experience.
- At least 2 years of work experience with a programming language such as Python, Mojo, Rust, or C++.
- Practical multi-tenancy security experience, large-scale ML inference infrastructure experience, and familiarity with Golang are helpful but not required.
Benefits
- Comprehensive healthcare coverage, retirement and savings programs, employee stock purchase opportunities, paid time off, wellbeing resources, family support programs, and learning and development opportunities may be included depending on location.
- The role may be performed remotely from home in the US or Canada or from the Los Altos, California office.
- New-hire onboarding is conducted in person at the Los Altos headquarters.
- Regular team onsites and local meetups are held, with travel expected two to four times per year.
- The company offers equity, including RSU grants, annual target bonuses, and other benefits; specific compensation details are excluded here.
Tech Stack
Categories
About Modular
Modular builds an AI developer platform for training and especially inference/serving, centered on the MAX runtime and the Mojo programming language. Its tools accelerate and deploy models from frameworks like PyTorch and TensorFlow on CPUs and GPUs, for teams running on cloud or on‑prem infrastructure. Founded in 2022, the company operates remote‑first with an office in Los Altos, CA, and sells a commercial platform and enterprise support to organizations productionizing generative and classical ML.