Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino

Jann Railey Montalan, Jian Gang Ngui, Wei Qi Leong, Yosephine Susanto, Hamsawardhini Rengarajan, Alham Fikri Aji, William Chandra Tjhi


Anthology ID:
2024.paclic-1.49
Volume:
Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation
Month:
December
Year:
2024
Address:
Tokyo, Japan
Editors:
Nathaniel Oco, Shirley N. Dita, Ariane Macalinga Borlongan, Jong-Bok Kim
Venue:
PACLIC
SIG:
Publisher:
Tokyo University of Foreign Studies
Note:
Pages:
497–523
Language:
URL:
https://preview.aclanthology.org/fix-sig-urls/2024.paclic-1.49/
DOI:
Bibkey:
Cite (ACL):
Jann Railey Montalan, Jian Gang Ngui, Wei Qi Leong, Yosephine Susanto, Hamsawardhini Rengarajan, Alham Fikri Aji, and William Chandra Tjhi. 2024. Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino. In Proceedings of the 38th Pacific Asia Conference on Language, Information and Computation, pages 497–523, Tokyo, Japan. Tokyo University of Foreign Studies.
Cite (Informal):
Kalahi: A handcrafted, grassroots cultural LLM evaluation suite for Filipino (Montalan et al., PACLIC 2024)
Copy Citation:
PDF:
https://preview.aclanthology.org/fix-sig-urls/2024.paclic-1.49.pdf