Statistical Augmentation of a Chinese Machine-Readable Dictionary

Pascale Fung, Dekai Wu


Abstract
We describe a method of using statistically-collected Chinese character groups from a corpus to augment a Chinese dictionary. The method is particularly useful for extracting domain-specific and regional words not readily available in machine-readable dictionaries. Output was evaluated both using human evaluators and against a previously available dictionary. We also evaluated performance improvement in automatic Chinese tokenization. Results show that our method outputs legitimate words, acronymic constructions, idioms, names and titles, as well as technical compounds, many of which were lacking from the original dictionary.
Anthology ID:
1994.vlc-1.6
Volume:
Second Workshop on Very Large Corpora
Month:
Year:
1994
Address:
Venue:
VLC
SIG:
Publisher:
Note:
Pages:
69–86
Language:
URL:
https://aclanthology.org/1994.vlc-1.6
DOI:
Bibkey:
Cite (ACL):
Pascale Fung and Dekai Wu. 1994. Statistical Augmentation of a Chinese Machine-Readable Dictionary. In Second Workshop on Very Large Corpora, pages 69–86.
Cite (Informal):
Statistical Augmentation of a Chinese Machine-Readable Dictionary (Fung & Wu, VLC 1994)
Copy Citation:
PDF:
https://preview.aclanthology.org/corrections-2024-07/1994.vlc-1.6.pdf