Automatic Manipulation of Training Corpora to Make Parsers Accept Real-world Text
Hiroshi Kanayama, Ran Iwamoto, Masayasu Muraoka, Takuya Ohko, Kohtaroh Miyamoto
Abstract
This paper discusses how to build a practical syntactic analyzer, and addresses the distributional differences between existing corpora and actual documents in applications. As a case study we focus on noun phrases that are not headed by a main verb and sentences without punctuation at the end, which are rare in a number of Universal Dependencies corpora but frequently appear in the real-world use cases of syntactic parsers. We converted the training corpora so that their distribution is closer to that in realistic inputs, and obtained the better scores both in general syntax benchmarking and a sentiment detection task, a typical application of dependency analysis.- Anthology ID:
- 2024.mwe-1.3
- Volume:
- Proceedings of the Joint Workshop on Multiword Expressions and Universal Dependencies (MWE-UD) @ LREC-COLING 2024
- Month:
- May
- Year:
- 2024
- Address:
- Torino, Italia
- Editors:
- Archna Bhatia, Gosse Bouma, A. Seza Doğruöz, Kilian Evang, Marcos Garcia, Voula Giouli, Lifeng Han, Joakim Nivre, Alexandre Rademaker
- Venues:
- MWE | UDW | WS
- SIGs:
- SIGLEX | SIGPARSE
- Publisher:
- ELRA and ICCL
- Note:
- Pages:
- 4–13
- Language:
- URL:
- https://aclanthology.org/2024.mwe-1.3
- DOI:
- Cite (ACL):
- Hiroshi Kanayama, Ran Iwamoto, Masayasu Muraoka, Takuya Ohko, and Kohtaroh Miyamoto. 2024. Automatic Manipulation of Training Corpora to Make Parsers Accept Real-world Text. In Proceedings of the Joint Workshop on Multiword Expressions and Universal Dependencies (MWE-UD) @ LREC-COLING 2024, pages 4–13, Torino, Italia. ELRA and ICCL.
- Cite (Informal):
- Automatic Manipulation of Training Corpora to Make Parsers Accept Real-world Text (Kanayama et al., MWE-UDW-WS 2024)
- PDF:
- https://preview.aclanthology.org/corrections-2024-07/2024.mwe-1.3.pdf