Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research
Surangika Ranathunga, Nisansa De Silva, Dilith Jayakody, Aloka Fernando
Abstract
We analysed a sample of NLP research papers archived in ACL Anthology as an attempt to quantify the degree of openness and the benefit of such an open culture in the NLP community. We observe that papers published in different NLP venues show different patterns related to artefact reuse. We also note that more than 30% of the papers we analysed do not release their artefacts publicly. Further, we observe a wide language-wise disparity in publicly available NLP-related artefacts.- Anthology ID:
- 2024.acl-short.48
- Volume:
- Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
- Month:
- August
- Year:
- 2024
- Address:
- Bangkok, Thailand
- Editors:
- Lun-Wei Ku, Andre Martins, Vivek Srikumar
- Venue:
- ACL
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 519–529
- Language:
- URL:
- https://aclanthology.org/2024.acl-short.48
- DOI:
- Cite (ACL):
- Surangika Ranathunga, Nisansa De Silva, Dilith Jayakody, and Aloka Fernando. 2024. Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 519–529, Bangkok, Thailand. Association for Computational Linguistics.
- Cite (Informal):
- Shoulders of Giants: A Look at the Degree and Utility of Openness in NLP Research (Ranathunga et al., ACL 2024)
- PDF:
- https://preview.aclanthology.org/nschneid-patch-4/2024.acl-short.48.pdf