Bo Ma
2022
ASCM: An Answer Space Clustered Prompting Method without Answer Engineering
Zhen Wang
|
Yating Yang
|
Zhou Xi
|
Bo Ma
|
Lei Wang
|
Rui Dong
|
Azmat Anwar
Findings of the Association for Computational Linguistics: ACL 2022
Prompt-based learning, which exploits knowledge from pre-trained language models by providing textual prompts and designing appropriate answer-category mapping methods, has achieved impressive successes on few-shot text classification and natural language inference (NLI). Because of the diverse linguistic expression, there exist many answer tokens for the same category. However, both manual answer design and automatic answer search constrain answer space and therefore hardly achieve ideal performance. To address this issue, we propose an answer space clustered prompting model (ASCM) together with a synonym initialization method (SI) which automatically categorizes all answer tokens in a semantic-clustered embedding space. We also propose a stable semi-supervised method named stair learning (SL) that orderly distills knowledge from better models to weaker models. Extensive experiments demonstrate that our ASCM+SL significantly outperforms existing state-of-the-art techniques in few-shot settings.
2021
基于时间注意力胶囊网络的维吾尔语情感分类模型(Uyghur Sentiment Classification Model Based on Temporal Attention Capsule Networks)
Hantian Luo (罗涵天)
|
Yating Yang (杨雅婷)
|
Rui Dong (董瑞)
|
Bo Ma (马博)
Proceedings of the 20th Chinese National Conference on Computational Linguistics
维吾尔语属于稀缺资源语言,如何在资源有限的情况下提升维吾尔语情感分类模型的性能,是目前待解决的问题。本文针对现有维吾尔语情感分析因为泛化能力不足所导致的分类效果不佳的问题,提出了基于时间卷积注意力胶囊网络的维吾尔语情感分类模型匨協十匭千卡印匩。本文在维吾尔语情感分类数据集中进行了实验并且从多个评价指标(准确率,精确率,召回率,F1值)进行评估,实验结果表明本文提出的模型相比传统深度学习模型可以有效提升维吾尔语情感分类的各项指标。
Search
Co-authors
- Yating Yang (杨雅婷) 2
- Rui Dong (董瑞) 2
- Hantian Luo (罗涵天) 1
- Zhen Wang 1
- Zhou Xi 1
- show all...