Zhi Guo
2026
A Novel Matching Paradigm: Unified Generative and Discriminative LLM with Prompt Compression for Relevance Learning
Guoliang Zhao | Zixin Cui | Chao Ye | Dengwu He | Fei Huang | Yubo Liu | Shuanglong Li | Tzungren Kuo | Bin Ding | Shuang Zhang | KunhongZhu | Zhi Guo | Liu Lin
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
Guoliang Zhao | Zixin Cui | Chao Ye | Dengwu He | Fei Huang | Yubo Liu | Shuanglong Li | Tzungren Kuo | Bin Ding | Shuang Zhang | KunhongZhu | Zhi Guo | Liu Lin
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)
The matching paradigm is fundamental to large-scale information retrieval and is widely used in industrial search and advertising systems. Existing approaches employ Large Language Models (LLMs) primarily as feature extractors, underutilizing their full modeling capabilities. To address this limitation, we propose a novel matching paradigm, termed the Unified Generative and Discriminative LLM (UGD). It integrates two-tower, single-tower, and generative tasks within a unified LLM framework via attention-mask partitioning, enabling generative tasks to serve as auxiliary supervision for discriminative learning and facilitating distillation from single-tower to two-tower architectures through a multi-task fine-tuning mechanism. To satisfy online latency constraints, we further introduce a self-distillation variant of UGD with a KMeans-enhanced linearized RQVAE for prompt compression and quantization. This design compresses and quantizes landing-page documents during inference, improving serving efficiency and reducing storage overhead. Extensive experiments show that UGD achieves superior performance and strong practical value. The framework has been deployed in an industrial search engine serving hundreds of millions of users and hundreds of thousands of advertisers, significantly enhancing search experience. Open access upon publication.
2023
Event Causality Extraction via Implicit Cause-Effect Interactions
Jintao Liu | Zequn Zhang | Kaiwen Wei | Zhi Guo | Xian Sun | Li Jin | Xiaoyu Li
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Jintao Liu | Zequn Zhang | Kaiwen Wei | Zhi Guo | Xian Sun | Li Jin | Xiaoyu Li
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Event Causality Extraction (ECE) aims to extract the cause-effect event pairs from the given text, which requires the model to possess a strong reasoning ability to capture event causalities. However, existing works have not adequately exploited the interactions between the cause and effect event that could provide crucial clues for causality reasoning. To this end, we propose an Implicit Cause-Effect interaction (ICE) framework, which formulates ECE as a template-based conditional generation problem. The proposed method captures the implicit intra- and inter-event interactions by incorporating the privileged information (ground truth event types and arguments) for reasoning, and a knowledge distillation mechanism is introduced to alleviate the unavailability of privileged information in the test stage. Furthermore, to facilitate knowledge transfer from teacher to student, we design an event-level alignment strategy named Cause-Effect Optimal Transport (CEOT) to strengthen the semantic interactions of cause-effect event types and arguments. Experimental results indicate that ICE achieves state-of-the-art performance on the ECE-CCKS dataset.