Ye-Yi Wang

Also published as: Ye-yi Wang


2023

pdf
Pre-training Multi-task Contrastive Learning Models for Scientific Literature Understanding
Yu Zhang | Hao Cheng | Zhihong Shen | Xiaodong Liu | Ye-Yi Wang | Jianfeng Gao
Findings of the Association for Computational Linguistics: EMNLP 2023

Scientific literature understanding tasks have gained significant attention due to their potential to accelerate scientific discovery. Pre-trained language models (LMs) have shown effectiveness in these tasks, especially when tuned via contrastive learning. However, jointly utilizing pre-training data across multiple heterogeneous tasks (e.g., extreme multi-label paper classification, citation prediction, and literature search) remains largely unexplored. To bridge this gap, we propose a multi-task contrastive learning framework, SciMult, with a focus on facilitating common knowledge sharing across different scientific literature understanding tasks while preventing task-specific skills from interfering with each other. To be specific, we explore two techniques – task-aware specialization and instruction tuning. The former adopts a Mixture-of-Experts Transformer architecture with task-aware sub-layers; the latter prepends task-specific instructions to the input text so as to produce task-aware outputs. Extensive experiments on a comprehensive collection of benchmark datasets verify the effectiveness of our task-aware specialization strategy, where we outperform state-of-the-art scientific pre-trained LMs. Code, datasets, and pre-trained models can be found at https://scimult.github.io/.

2015

pdf
Representation Learning Using Multi-Task Deep Neural Networks for Semantic Classification and Information Retrieval
Xiaodong Liu | Jianfeng Gao | Xiaodong He | Li Deng | Kevin Duh | Ye-yi Wang
Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

2007

pdf
Voice-Rate: A Dialog System for Consumer Ratings
Geoffrey Zweig | Y.C. Ju | Patrick Nguyen | Dong Yu | Ye-Yi Wang | Alex Acero
Proceedings of Human Language Technologies: The Annual Conference of the North American Chapter of the Association for Computational Linguistics (NAACL-HLT)

pdf bib
Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies
Fuliang Weng | Ye-Yi Wang | Gokhan Tur
Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies

2006

pdf
Combining Statistical and Knowledge-Based Spoken Language Understanding in Conditional Models
Ye-Yi Wang | Alex Acero | Milind Mahajan | John Lee
Proceedings of the COLING/ACL 2006 Main Conference Poster Sessions

2004

pdf
Use and Acquisition of Semantic Language Model
Kuansan Wang | Ye-Yi Wang | Alex Acero
Demonstration Papers at HLT-NAACL 2004

1998

pdf
Modeling with Structures in Statistical Machine translation
Ye-Yi Wang | Alex Waibel
36th Annual Meeting of the Association for Computational Linguistics and 17th International Conference on Computational Linguistics, Volume 2

pdf
Modeling with Structures in Statistical Machine Translation
Ye-Yi Wang | Alex Waibel
COLING 1998 Volume 2: The 17th International Conference on Computational Linguistics

1997

pdf
Decoding Algorithm in Statistical Machine Translation
Ye-Yi Wang | Alex Waibel
35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics

1994

pdf
Dual-Coding Theory and Connectionist Lexical Selection
Ye-Yi Wang
32nd Annual Meeting of the Association for Computational Linguistics