Ma. Regina E. Estuar
2024
Zero-shot Cross-lingual POS Tagging for Filipino
Jimson Layacan
|
Isaiah Edri W. Flores
|
Katrina Tan
|
Ma. Regina E. Estuar
|
Jann Montalan
|
Marlene M. De Leon
Proceedings of the 3rd Workshop on NLP Applications to Field Linguistics (Field Matters 2024)
Supervised learning approaches in NLP, exemplified by POS tagging, rely heavily on the presence of large amounts of annotated data. However, acquiring such data often requires significant amount of resources and incurs high costs. In this work, we explore zero-shot cross-lingual transfer learning to address data scarcity issues in Filipino POS tagging, particularly focusing on optimizing source language selection. Our zero-shot approach demonstrates superior performance compared to previous studies, with top-performing fine-tuned PLMs achieving F1 scores as high as 79.10%. The analysis reveals moderate correlations between cross-lingual transfer performance and specific linguistic distances–featural, inventory, and syntactic–suggesting that source languages with these features closer to Filipino provide better results. We identify tokenizer optimization as a key challenge, as PLM tokenization sometimes fails to align with meaningful representations, thus hindering POS tagging performance.
Search