Systems Software Engineer
Micron Technology2 days ago
Responsibilities
- Design and modify AI inference software stacks to demonstrate proof-of-concept hardware capabilities.
- Develop software that quantifies and demonstrates the value of proposed system features.
- Lead software architecture and development independently and as a technical lead for small teams.
- Research emerging AI software topics and identify memory and storage system challenges and opportunities.
- Develop Linux applications and libraries using C, C++, Python, Rust, CUDA, and/or SYCL.
- Develop and use emulators to predict system-level performance and functional impacts before hardware is available.
- Debug issues across applications, libraries, operating systems, kernels, system configuration, networks, and hardware/software interfaces.
- Collaborate with Micron organizations and external partners, mentor interns and early-career engineers, and present technical findings to internal or external customers.
- Use emerging AI tools to improve productivity.
Requirements
- Bachelor’s or Master’s degree with 10+ years of experience, or a PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
- Hands-on experience developing across multiple layers of end-to-end AI inference software stacks, including frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers.
- Proficiency in C, C++, and Python, with Linux-specific programming experience including multithreading, IPC, ioctl, GDB, and the /proc and /sys filesystems.
- Experience programming GPUs or other accelerators using CUDA, SYCL, OpenCL, or a comparable programming model.
- Experience debugging software and systems across applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
- Ability to lead technical initiatives without supervisory authority.
- Familiarity with LLM serving internals, including KV-cache management, prefill and decode phases, KV-cache offloading, and disaggregated serving.
- Familiarity with SGLang, vLLM, NVIDIA Dynamo, or TensorRT-LLM.
- Strong understanding of heterogeneous compute architectures, memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.
- Preferred qualifications include technical leadership in systems-focused pathfinding or research organizations and knowledge of HBM, DRAM, emerging memory technologies, NVMe SSDs, NAND, and next-generation storage systems.
Benefits
- Medical, dental, and vision plans.
- Income-protection benefits for illness or injury and paid family leave.
- Paid time off and paid holidays.
- Equal opportunity and affirmative action workplace.
About Micron Technology
Micron Technology designs and manufactures memory and storage semiconductors—DRAM, NAND, NOR and SSDs—sold to device makers, cloud providers, and embedded/automotive markets. Founded in 1978 and headquartered in Boise, Idaho, it operates globally and sells under the Micron and Crucial brands as a public company (NASDAQ: MU). Its products support data center, AI, mobile, and PC systems, including high-bandwidth and multichip packages for performance- and space-constrained applications.