
Principal Systems Software Engineer - AI Inference & Hardware/Software Co-Design
Micron Technology10 days ago
Responsibilities
- Design and modify AI inference software stacks to demonstrate proof-of-concept hardware capabilities.
- Develop software to quantify and demonstrate the value of proposed system features.
- Lead software architecture and development efforts independently and as a technical lead for small teams.
- Research emerging AI software topics and identify memory and storage system challenges and opportunities.
- Develop and modify Linux applications and libraries for heterogeneous computing systems.
- Develop and use emulators to predict system-level performance and functional impacts before hardware availability.
- Debug issues spanning applications, libraries, operating systems, kernels, system configuration, networks, and hardware/software interfaces.
- Collaborate across Micron organizations and with external partners.
- Mentor interns and earlier-career engineers.
- Present technical findings, insights, and innovations to internal or external customers.
Requirements
- Bachelor’s or Master’s degree with 10+ years of experience, or a PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
- Working knowledge of end-to-end AI inference software stack architectures and hands-on development across multiple layers such as frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers.
- Experience debugging across applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
- Proficiency in C, C++, and Python, including Linux-specific programming with multithreading, IPC, ioctl, GDB, and the /proc and /sys filesystems.
- Experience programming GPUs or other accelerators with CUDA, SYCL, OpenCL, or a comparable programming model.
- Ability to lead technical initiatives without supervisory authority.
- Familiarity with LLM serving internals, including KV-cache management, prefill and decode phases, KV-cache offloading, and disaggregated serving.
- Familiarity with inference engines and distributed serving frameworks such as SGLang, vLLM, NVIDIA Dynamo, or TensorRT-LLM.
- Strong understanding of heterogeneous compute architectures, memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.
- Preferred qualifications include technical leadership in systems-focused pathfinding or research organizations and knowledge of HBM, DRAM, emerging memory technologies, NVMe SSDs, NAND, and next-generation storage systems.
Benefits
- Medical, dental, and vision plans are available in all locations.
- Income protection programs are provided for illness or injury.
- Paid family leave is available.
- Robust paid time off and paid holidays are provided.
- Micron offers professional growth and wellbeing programs.
About Micron Technology
Micron Technology designs and manufactures memory and storage semiconductors—DRAM, NAND, NOR and SSDs—sold to device makers, cloud providers, and embedded/automotive markets. Founded in 1978 and headquartered in Boise, Idaho, it operates globally and sells under the Micron and Crucial brands as a public company (NASDAQ: MU). Its products support data center, AI, mobile, and PC systems, including high-bandwidth and multichip packages for performance- and space-constrained applications.