3 months ago
Base Salary
$195k - $285k/yr
Responsibilities
- Develop, enhance, maintain, and productize the software stack for d-Matrix’s AI compute engine.
- Build and scale next-generation AI deployment software and deployment infrastructure.
- Work across the full-stack toolchain and optimize hardware-software co-design trade-offs.
- Design and implement distributed, high-performance software within tight development windows.
- Collaborate with system software, ML, compiler, and hardware experts.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Math, Physics, or a related field and 12+ years of industry software development experience.
- Master’s or PhD in Computer Science, Electrical Engineering, or a related field is preferred.
- Strong understanding of system software, data structures, computer architecture, and machine learning fundamentals.
- Proficiency in C, C++, Python, Linux, and standard development tools.
- Experience designing and implementing distributed, high-performance software.
- Experience with inference servers or model-serving frameworks such as TensorRT-LLM, vLLM, and SGLang.
- Experience with PyTorch, TensorFlow, ONNX Runtime, TensorRT, NCCL, and OpenMPI is preferred.
- Experience with software testing fundamentals and deploying LLM, VLM, or NLP workloads on distributed systems is preferred.
- Experience with Kubernetes, Ray, or other MLOps tools and techniques from definition through deployment is preferred.
- Startup, small-team, incubation, cloud-provider, or AI compute/subsystem company experience is preferred.
- Strong ownership, leadership, collaboration, and execution skills.
Benefits
- Hybrid work arrangement with onsite work at the Santa Clara, California headquarters three days per week.
- Inclusive equal-opportunity workplace committed to collaboration, respect, and employee empowerment.
Tech Stack
Categories
About d-Matrix
d-Matrix builds AI inference computing platforms for data centers, combining custom silicon with systems, networking, and software. Its flagship Corsair platform and JetStream fabric focus on low-latency, energy-efficient generative AI inference at scale. Founded in 2019 and headquartered in Santa Clara, California, the privately held company sells hardware with accompanying software to cloud providers and enterprises deploying large AI models.