Abstract
We investigate the design challenges of constructing effective and efficient neural sequence labeling systems, by reproducing twelve neural sequence labeling models, which include most of the state-of-the-art structures, and conduct a systematic model comparison on three benchmarks (i.e. NER, Chunking, and POS tagging). Misconceptions and inconsistent conclusions in existing literature are examined and clarified under statistical experiments. In the comparison and analysis process, we reach several practical conclusions which can be useful to practitioners.- Anthology ID:
- C18-1327
- Volume:
- Proceedings of the 27th International Conference on Computational Linguistics
- Month:
- August
- Year:
- 2018
- Address:
- Santa Fe, New Mexico, USA
- Venue:
- COLING
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 3879–3889
- Language:
- URL:
- https://aclanthology.org/C18-1327
- DOI:
- Cite (ACL):
- Jie Yang, Shuailong Liang, and Yue Zhang. 2018. Design Challenges and Misconceptions in Neural Sequence Labeling. In Proceedings of the 27th International Conference on Computational Linguistics, pages 3879–3889, Santa Fe, New Mexico, USA. Association for Computational Linguistics.
- Cite (Informal):
- Design Challenges and Misconceptions in Neural Sequence Labeling (Yang et al., COLING 2018)
- PDF:
- https://preview.aclanthology.org/ingestion-script-update/C18-1327.pdf
- Code
- jiesutd/NCRFpp + additional community code
- Data
- Penn Treebank