@inproceedings{wongso-etal-2025-nusabert,
    title = "{N}usa{BERT}: Teaching {I}ndo{BERT} to be Multilingual and Multicultural",
    author = "Wongso, Wilson  and
      Setiawan, David Samuel  and
      Limcorn, Steven  and
      Joyoadikusumo, Ananto",
    editor = "Wijaya, Derry  and
      Aji, Alham Fikri  and
      Vania, Clara  and
      Winata, Genta Indra  and
      Purwarianti, Ayu",
    booktitle = "Proceedings of the Second Workshop in South East Asian Language Processing",
    month = jan,
    year = "2025",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/2025.sealp-1.2/",
    pages = "10--26",
    abstract = "We present NusaBERT, a multilingual model built on IndoBERT and tailored for Indonesia`s diverse languages. By expanding vocabulary and pre-training on a regional corpus, NusaBERT achieves state-of-the-art performance on Indonesian NLU benchmarks, enhancing IndoBERT`s multilingual capability. This study also addresses NusaBERT`s limitations and encourages further research on Indonesia`s underrepresented languages."
}