Chang-Dong Wang
2026
AscendKernelGen: LLM-Driven Kernel Generation for NPUs
Xinzi Cao | Jianyang Zhai | Pengfei Li | Zhiheng Hu | Cen Yan | Mubingxu | Guanghuan Fang | Bin She | Jiayu Li | Yihan Su | Dongyang Tao | Feidiao Yang | Chang-Dong Wang | Yutong Lu | Weicheng Xue | Bin Zhou | Yonghong Tian
Findings of the Association for Computational Linguistics: ACL 2026
Xinzi Cao | Jianyang Zhai | Pengfei Li | Zhiheng Hu | Cen Yan | Mubingxu | Guanghuan Fang | Bin She | Jiayu Li | Yihan Su | Dongyang Tao | Feidiao Yang | Chang-Dong Wang | Yutong Lu | Weicheng Xue | Bin Zhou | Yonghong Tian
Findings of the Association for Computational Linguistics: ACL 2026
Neural Processing Units (NPUs) are critical for AI infrastructure, yet developing kernels remains a bottleneck due to the complexity of vendor-specific Domain-Specific Languages (DSLs). While LLMs excel in general coding, they fail to meet the stringent constraints of NPU development, showing a near-zero success rate on complex kernels in our preliminary study. To address these challenges, we present AscendKernelGen, the first comprehensive framework for NPU kernel development, marking a pioneering effort in this field. This framework consists of three interconnected components: (1) Ascend-CoT, the first dataset in the NPU kernel domain that incorporates chain-of-thought reasoning from real-world kernel implementations; (2) KernelGen-LM, a domain-adaptive model trained on this novel dataset using supervised fine-tuning and reinforcement learning; and (3) NPUKernelBench, the first benchmark platform designed to evaluate the compilation, correctness, and performance of generated NPU kernels. Experimental results demonstrate that our approach dramatically bridges the gap in hardware-specific coding: compilation success on complex Level-2 kernels improves from 0% to 95.5% (Pass@10), with 64% functional correctness. AscendKernGen is available at AscendKernGen and NPUKernelBench.
2025
Learning Transition Patterns by Large Language Models for Sequential Recommendation
Jianyang Zhai | Zi-Feng Mai | Dongyi Zheng | Chang-Dong Wang | Xiawu Zheng | Hui Li | Feidiao Yang | Yonghong Tian
Proceedings of the 31st International Conference on Computational Linguistics
Jianyang Zhai | Zi-Feng Mai | Dongyi Zheng | Chang-Dong Wang | Xiawu Zheng | Hui Li | Feidiao Yang | Yonghong Tian
Proceedings of the 31st International Conference on Computational Linguistics
Large Language Models (LLMs) have demonstrated powerful performance in sequential recommendation due to their robust language modeling and comprehension capabilities. In such paradigms, the item texts of interaction sequences are formulated as sentences and LLMs are utilized to learn language representations or directly generate target item texts by incorporating instructions. Despite their promise, these methods solely focus on modeling the mapping from sequential texts to target items, neglecting the relationship between the items in an interaction sequence. This results in a failure to learn the transition patterns between items, which reflect the dynamic change in user preferences and are crucial for predicting the next item. To tackle this issue, we propose a novel framework for mapping the sequential item texts to the sequential item IDs, named ST2SI. Specifically, we first introduce multi-query input and item linear projection (ILP) to model the conditional probability distribution of items. Then, we further propose ID alignment to address misalignment between item texts and item IDs by instruction tuning. Finally, we propose efficient ILP tuning to adapt flexibly to different scenarios, requiring only training a linear layer to achieve competitive performance. Extensive experiments on six real-world datasets show our approach outperforms the best baselines by 7.33% in NDCG@10, 4.65% in Recall@10, and 8.42% in MRR.