Challenges of Building Domain-Specific Parallel Corpora from Public Administration Documents
Filip Klubička, Lorena Kasunić, Danijel Blazsetin, Petra Bago
Abstract
PRINCIPLE was a Connecting Europe Facility (CEF)-funded project that focused on the identification, collection and processing of language resources (LRs) for four European under-resourced languages (Croatian, Icelandic, Irish and Norwegian) in order to improve translation quality of eTranslation, an online machine translation (MT) tool provided by the European Commission. The collected LRs were used for the development of neural MT engines in order to verify the quality of the resources. For all four languages, a total of 66 LRs were collected and made available on the ELRC-SHARE repository under various licenses. For Croatian, we have collected and published 20 LRs: 19 parallel corpora and 1 glossary. The majority of data is in the general domain (72 % of translation units), while the rest is in the eJustice (23 %), eHealth (3 %) and eProcurement (2 %) Digital Service Infrastructures (DSI) domains. The majority of the resources were for the Croatian-English language pair. The data was donated by six data contributors from the public as well as private sector. In this paper we present a subset of 13 Croatian LRs developed based on public administration documents, which are all made freely available, as well as challenges associated with the data collection, cleaning and processing.- Anthology ID:
- 2022.bucc-1.7
- Volume:
- Proceedings of the BUCC Workshop within LREC 2022
- Month:
- June
- Year:
- 2022
- Address:
- Marseille, France
- Editors:
- Reinhard Rapp, Pierre Zweigenbaum, Serge Sharoff
- Venue:
- BUCC
- SIG:
- Publisher:
- European Language Resources Association
- Note:
- Pages:
- 50–55
- Language:
- URL:
- https://aclanthology.org/2022.bucc-1.7
- DOI:
- Cite (ACL):
- Filip Klubička, Lorena Kasunić, Danijel Blazsetin, and Petra Bago. 2022. Challenges of Building Domain-Specific Parallel Corpora from Public Administration Documents. In Proceedings of the BUCC Workshop within LREC 2022, pages 50–55, Marseille, France. European Language Resources Association.
- Cite (Informal):
- Challenges of Building Domain-Specific Parallel Corpora from Public Administration Documents (Klubička et al., BUCC 2022)
- PDF:
- https://preview.aclanthology.org/naacl24-info/2022.bucc-1.7.pdf