Zhenyu Wu
2023
OpenICL: An Open-Source Framework for In-context Learning
Zhenyu Wu
|
Yaoxiang Wang
|
Jiacheng Ye
|
Zhiyong Wu
|
Jiangtao Feng
|
Jingjing Xu
|
Yu Qiao
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations)
In recent years, In-context Learning (ICL) has gained increasing attentionand emerged as the new paradigm for large language model (LLM) evaluation. Unlike traditional fine-tuning methods, ICL instead adapts the pre-trained models to unseen tasks without any parameter updates.However, the implementation of ICL is sophisticated due to the diverse retrieval and inference methods involved, as well as the varying pre-processing requirements for different models, datasets, and tasks. A unified and flexible framework for ICL is urgently needed to ease the implementation of the aforementioned components.To facilitate ICL research, we introduce OpenICL, an open-source toolkit for ICL and LLM evaluation. OpenICL is research-friendly with a highly flexible architecture that users can easily combine different components to suit their needs.It also provides various state-of-the-art retrieval and inference methods to streamline the process of adapting ICL to cutting-edge research.The effectiveness of OpenICL has been validated on a wide range of NLP tasks, including classification, QA, machine translation, and semantic parsing. As a side-product, we found OpenICL to be an efficient yet robust tool for LLMs evaluation. OpenICL is released at https://github.com/Shark-NLP/OpenICL.
2002
PCFG Parsing for Restricted Classical Chinese Texts
Liang Huang
|
Yinan Peng
|
Huan Wang
|
Zhenyu Wu
COLING-02: The First SIGHAN Workshop on Chinese Language Processing
Search
Co-authors
- Yaoxiang Wang 1
- Jiacheng Ye 1
- Zhiyong Wu 1
- Jiangtao Feng 1
- Jingjing Xu 1
- show all...