Micron Technology

Principal Systems Software Engineer - AI Inference & Hardware/Software Co-Design

Micron Technology
Apply
10 days ago
Richardson, TX, USAStaff+
H1B sponsor

Responsibilities

  • Design and modify AI inference software stacks to demonstrate proof-of-concept hardware capabilities.
  • Develop software to quantify and demonstrate the value of proposed system features.
  • Lead software architecture and development efforts independently and as a technical lead for small teams.
  • Research emerging AI software topics and identify memory and storage system challenges and opportunities.
  • Develop and modify Linux applications and libraries for heterogeneous computing systems.
  • Develop and use emulators to predict system-level performance and functional impacts before hardware availability.
  • Debug issues spanning applications, libraries, operating systems, kernels, system configuration, networks, and hardware/software interfaces.
  • Collaborate across Micron organizations and with external partners.
  • Mentor interns and earlier-career engineers.
  • Present technical findings, insights, and innovations to internal or external customers.

Requirements

  • Bachelor’s or Master’s degree with 10+ years of experience, or a PhD with 7+ years of experience, in Computer Science, Software Engineering, Computer Engineering, or a related field.
  • Working knowledge of end-to-end AI inference software stack architectures and hands-on development across multiple layers such as frameworks, inference engines, ML compilers, compiler infrastructure, hardware runtimes, or hardware abstraction layers.
  • Experience debugging across applications, libraries, operating systems, kernels, networks, and hardware/software interfaces.
  • Proficiency in C, C++, and Python, including Linux-specific programming with multithreading, IPC, ioctl, GDB, and the /proc and /sys filesystems.
  • Experience programming GPUs or other accelerators with CUDA, SYCL, OpenCL, or a comparable programming model.
  • Ability to lead technical initiatives without supervisory authority.
  • Familiarity with LLM serving internals, including KV-cache management, prefill and decode phases, KV-cache offloading, and disaggregated serving.
  • Familiarity with inference engines and distributed serving frameworks such as SGLang, vLLM, NVIDIA Dynamo, or TensorRT-LLM.
  • Strong understanding of heterogeneous compute architectures, memory hierarchies, NUMA, caching, accelerator architectures, and interconnects such as PCIe, CXL, NVLink, or UALink.
  • Preferred qualifications include technical leadership in systems-focused pathfinding or research organizations and knowledge of HBM, DRAM, emerging memory technologies, NVMe SSDs, NAND, and next-generation storage systems.

Benefits

  • Medical, dental, and vision plans are available in all locations.
  • Income protection programs are provided for illness or injury.
  • Paid family leave is available.
  • Robust paid time off and paid holidays are provided.
  • Micron offers professional growth and wellbeing programs.
Micron Technology

About Micron Technology

10,000+ employees

Micron Technology designs and manufactures memory and storage semiconductors—DRAM, NAND, NOR and SSDs—sold to device makers, cloud providers, and embedded/automotive markets. Founded in 1978 and headquartered in Boise, Idaho, it operates globally and sells under the Micron and Crucial brands as a public company (NASDAQ: MU). Its products support data center, AI, mobile, and PC systems, including high-bandwidth and multichip packages for performance- and space-constrained applications.

Contact me