Intern - AI Systems and Infrastructure Engineering
Micron Technology3 days ago
Responsibilities
- Develop systems software, profiling tools, and experimentation frameworks for LLM training, LLM inference, and Agentic AI workloads.
- Design and evaluate caching, tiering, compression, eviction, and lifecycle-management techniques for AI serving environments.
- Characterize and optimize workload execution across GPUs, CPUs, memory, storage, and distributed infrastructure for latency, throughput, scalability, and resource utilization.
- Build benchmarking, simulation, and automation capabilities for data placement, migration, scheduling, and performance evaluation across heterogeneous memory systems.
- Collaborate with engineering and research teams on workloads, experimental analysis, technical publications, intellectual property, and future platform designs.
Requirements
- Currently pursuing a master’s or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
- Demonstrated experience with AI systems, machine learning systems, computer systems research, or systems software through coursework, research, or projects.
- Understanding of LLM transformer execution, attention mechanisms, KV-cache behavior, batching, token-level latency, throughput, and memory performance.
- Proficiency in Python and C/C++, with hands-on experience developing, debugging, and optimizing software in Linux environments.
- Experience with GPU-based performance analysis tools and at least one AI framework or serving stack such as PyTorch, vLLM, TensorRT-LLM, or NVIDIA Dynamo.
- Preferred: experience optimizing LLM runtimes, serving engines, schedulers, distributed inference frameworks, KV-cache or memory-management techniques, GPU optimization, heterogeneous memory, or high-performance computing.
- Preferred: evidence of technical impact through publications, patents, open-source contributions, or substantial related research and engineering projects.
Benefits
- Medical, dental, and vision plan options.
- Income protection benefits for illness or injury and paid family leave.
- Paid time off and paid holidays.
- Professional growth opportunities and additional benefit programs described in Micron’s Benefits Guide.
Categories
About Micron Technology
Micron is an industry leader in innovative memory and storage solutions transforming how the world uses information to enrich life for all. With a relentless focus on our customers, technology leadership, and manufacturing and operational excellence, Micron delivers a rich portfolio of high-performance DRAM, NAND and NOR memory and storage products through our Micron® and Crucial® brands. Every day, the innovations that our people create fuel the data economy, enabling advances in artificial intelligence (AI) and compute-intensive applications that unleash opportunities — from the data center to the intelligent edge and across the client and mobile user experience. To learn more about Micron Technology, Inc. (Nasdaq: MU), visit micron.com.