3 days ago
Shanghai, ChinaSenior
Responsibilities
- Develop and optimize AI kernels and operators for Qualcomm Cloud AI platforms.
- Enable and optimize LLM, MoE, and multimodal models for large-scale cloud inference.
- Drive accuracy, performance, and efficiency improvements across the software stack.
- Improve model memory footprint and ROM/RAM efficiency through kernel, graph, and compiler optimizations.
- Collaborate with performance and modeling teams to deliver efficient inference systems.
- Analyze and resolve performance bottlenecks using profiling, benchmarking, and modeling methods.
- Develop custom operators and high-performance kernels manually or through compiler frameworks for AI accelerator platforms.
Requirements
- A master's degree or above in Computer Science, Artificial Intelligence, Mathematics, Electrical Engineering, or a related field is listed in the required qualifications.
- At least 5 years of experience in Cloud AI inference, kernel/operator development, or AI compiler technologies is listed in the required qualifications.
- Proficiency in C++, Python, and Linux development environments.
- Deep understanding of Transformer architectures, including LLMs, MoE, and modern foundation models.
- Strong experience with MLIR, Triton, TVM, or similar compiler frameworks and compiler optimization techniques.
- Strong experience with parallel computing architectures, vectorization, tiling, memory hierarchy optimization, and workload scheduling.
- Strong experience with graph optimization, model accuracy validation, performance optimization, and memory optimization.
- Good verbal and written English communication skills for collaboration across global teams.
- Preferred experience includes optimizing Attention, FlashAttention, KV Cache, Embedding, GEMM, Softmax, and MoE routing operators.
- Preferred experience includes developing kernels for GPUs, NPUs, TPUs, or custom AI hardware.
- Minimum qualifications allow a bachelor's degree with 2+ years of related experience, a master's degree with 1+ year of related experience, or a PhD in a related field.
- At least 2 years of academic or work experience with programming languages such as C, C++, Java, or Python.
Categories
About Qualcomm
Qualcomm is a public semiconductor company headquartered in San Diego, founded in 1985, that designs and sells wireless chipsets and platforms for mobile devices, automotive, IoT, and networking, notably the Snapdragon application processors and 5G modems. It also licenses a large portfolio of cellular patents to device makers, generating revenue alongside chip sales; its technology underpins many Android smartphones and emerging automotive and edge-compute systems, and it trades on NASDAQ as QCOM.