TransPOS: Transformers for Consolidating Different POS Tagset Datasets

Alex Li, Ilyas Bankole-Hameed, Ranadeep Singh, Gabriel Ng, Akshat Gupta


Abstract
In hope of expanding training data, researchers often want to merge two or more datasets that are created using different labeling schemes. This paper considers two datasets that label part-of-speech (POS) tags under different tagging schemes and leverage the supervised labels of one dataset to help generate labels for the other dataset. This paper further discusses the theoretical difficulties of this approach and proposes a novel supervised architecture employing Transformers to tackle the problem of consolidating two completely disjoint datasets. The results diverge from initial expectations and discourage exploration into the use of disjoint labels to consolidate datasets with different labels.
Anthology ID:
2022.wnut-1.9
Volume:
Proceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022)
Month:
October
Year:
2022
Address:
Gyeongju, Republic of Korea
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
90–95
Language:
URL:
https://aclanthology.org/2022.wnut-1.9
DOI:
Bibkey:
Cite (ACL):
Alex Li, Ilyas Bankole-Hameed, Ranadeep Singh, Gabriel Ng, and Akshat Gupta. 2022. TransPOS: Transformers for Consolidating Different POS Tagset Datasets. In Proceedings of the Eighth Workshop on Noisy User-generated Text (W-NUT 2022), pages 90–95, Gyeongju, Republic of Korea. Association for Computational Linguistics.
Cite (Informal):
TransPOS: Transformers for Consolidating Different POS Tagset Datasets (Li et al., WNUT 2022)
Copy Citation:
PDF:
https://preview.aclanthology.org/naacl-24-ws-corrections/2022.wnut-1.9.pdf
Data
CityscapesTweebank