2022
pdf
abs
LaVA – Latvian Language Learner corpus
Roberts Darģis
|
Ilze Auziņa
|
Inga Kaija
|
Kristīne Levāne-Petrova
|
Kristīne Pokratniece
Proceedings of the Thirteenth Language Resources and Evaluation Conference
This paper presents the Latvian Language Learner Corpus (LaVA) developed at the Institute of Mathematics and Computer Science, University of Latvia. LaVA corpus contains 1015 essays (190k tokens and 790k characters excluding whitespaces) from foreigners studying at Latvian higher education institutions and who are learning Latvian as a foreign language in the first or second semester, reaching the A1 (possibly A2) Latvian language proficiency level. The corpus has morphological and error annotations. Error analysis and the statistics of the LaVA corpus are also provided in the paper. The corpus is publicly available at:
http://www.korpuss.lv/id/LaVA.
pdf
abs
Latvian National Corpora Collection – Korpuss.lv
Baiba Saulite
|
Roberts Darģis
|
Normunds Gruzitis
|
Ilze Auzina
|
Kristīne Levāne-Petrova
|
Lauma Pretkalniņa
|
Laura Rituma
|
Peteris Paikens
|
Arturs Znotins
|
Laine Strankale
|
Kristīne Pokratniece
|
Ilmārs Poikāns
|
Guntis Barzdins
|
Inguna Skadiņa
|
Anda Baklāne
|
Valdis Saulespurēns
|
Jānis Ziediņš
Proceedings of the Thirteenth Language Resources and Evaluation Conference
LNCC is a diverse collection of Latvian language corpora representing both written and spoken language and is useful for both linguistic research and language modelling. The collection is intended to cover diverse Latvian language use cases and all the important text types and genres (e.g. news, social media, blogs, books, scientific texts, debates, essays, etc.), taking into account both quality and size aspects. To reach this objective, LNCC is a continuous multi-institutional and multi-project effort, supported by the Digital Humanities and Language Technology communities in Latvia. LNCC includes a broad range of Latvian texts from the Latvian National Library, Culture Information Systems Centre, Latvian National News Agency, Latvian Parliament, Latvian web crawl, various Latvian publishers, and from the Latvian language corpora created by Institute of Mathematics and Computer Science and its partners, including spoken language corpora. All corpora of LNCC are re-annotated with a uniform morpho-syntactic annotation scheme which enables federated search and consistent linguistics analysis in all the LNCC corpora, as well as facilitates to select and mix various corpora for pre-training large Latvian language models like BERT and GPT.
2020
pdf
abs
Deriving a PropBank Corpus from Parallel FrameNet and UD Corpora
Normunds Gruzitis
|
Roberts Darģis
|
Laura Rituma
|
Gunta Nešpore-Bērzkalne
|
Baiba Saulite
Proceedings of the International FrameNet Workshop 2020: Towards a Global, Multilingual FrameNet
We propose an approach for generating an accurate and consistent PropBank-annotated corpus, given a FrameNet-annotated corpus which has an underlying dependency annotation layer, namely, a parallel Universal Dependencies (UD) treebank. The PropBank annotation layer of such a multi-layer corpus can be semi-automatically derived from the existing FrameNet and UD annotation layers, by providing a mapping configuration from lexical units in [a non-English language] FrameNet to [English language] PropBank predicates, and a mapping configuration from FrameNet frame elements to PropBank semantic arguments for the given pair of a FrameNet frame and a PropBank predicate. The latter mapping generally depends on the underlying UD syntactic relations. To demonstrate our approach, we use Latvian FrameNet, annotated on top of Latvian UD Treebank, for generating Latvian PropBank in compliance with the Universal Propositions approach.
pdf
abs
Quality Focused Approach to a Learner Corpus Development
Roberts Darģis
|
Ilze Auziņa
|
Kristīne Levāne-Petrova
|
Inga Kaija
Proceedings of the Twelfth Language Resources and Evaluation Conference
The paper presents quality focused approach to a learner corpus development. The methodology was developed with multiple design considerations put in place to make the annotation process easier and at the same time reduce the amount of mistakes that could be introduced due to inconsistent text correction or carelessness. The approach suggested in this paper consists of multiple parts: comparison of digitized texts by several annotators, text correction, automated morphological analysis, and manual review of annotations. The described approach is used to create Latvian Language Learner corpus (LaVA) which is part of a currently ongoing project Development of Learner corpus of Latvian: methods, tools and applications.
pdf
abs
Development and Evaluation of Speech Synthesis Corpora for Latvian
Roberts Darģis
|
Peteris Paikens
|
Normunds Gruzitis
|
Ilze Auzina
|
Agate Akmane
Proceedings of the Twelfth Language Resources and Evaluation Conference
Text to speech (TTS) systems are necessary for all languages to ensure accessibility and availability of digital language services. Recent advances in neural speech synthesis have eText to speech (TTS) systems are necessary for any language to ensure accessibility and availability of digital language services. Recent advances in neural speech synthesis have enabled the development of such systems with a data-driven approach that does not require significant development of language-specific tools. However, smaller languages often lack speech corpora that would be sufficient for training current neural TTS models, which require at least 30 hours of good quality audio recordings from a single speaker in a noiseless environment with matching transcriptions. Making such a corpus manually can be cost prohibitive. This paper presents an unsupervised approach to obtain a suitable corpus from unannotated recordings using automated speech recognition for transcription, as well as automated speaker segmentation and identification. The proposed method and software tools are applied and evaluated on a case study for developing a corpus suitable for Latvian speech synthesis based on Latvian public radio archive data.nabled the development of such systems with a data-driven approach that does not require much language-specific tool development. However, smaller languages often lack speech corpora that would be sufficient for training current neural TTS models, which require approximately 30 hours of good quality audio recordings from a single speaker in a noiseless environment with matching transcriptions. Making such a corpus manually can be cost prohibitive. This paper presents an unsupervised approach to obtain a suitable corpus from unannotated recordings using automated speech recognition for transcription, as well as automated speaker segmentation and identification. The proposed methods and software tools are applied and evaluated on a case study for developing a corpus suitable for Latvian speech synthesis based on Latvian public radio archive data.
2018
pdf
The Use of Text Alignment in Semi-Automatic Error Analysis: Use Case in the Development of the Corpus of the Latvian Language Learners
Roberts Darģis
|
Ilze Auziņa
|
Kristīne Levāne-Petrova
Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018)
2016
pdf
abs
Tēzaurs.lv: the Largest Open Lexical Database for Latvian
Andrejs Spektors
|
Ilze Auzina
|
Roberts Dargis
|
Normunds Gruzitis
|
Peteris Paikens
|
Lauma Pretkalnina
|
Laura Rituma
|
Baiba Saulite
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
We describe an extensive and versatile lexical resource for Latvian, an under-resourced Indo-European language, which we call Tezaurs (Latvian for ‘thesaurus’). It comprises a large explanatory dictionary of more than 250,000 entries that are derived from more than 280 external sources. The dictionary is enriched with phonetic, morphological, semantic and other annotations, as well as augmented by various language processing tools allowing for the generation of inflectional forms and pronunciation, for on-the-fly selection of corpus examples, for suggesting synonyms, etc. Tezaurs is available as a public and widely used web application for end-users, as an open data set for the use in language technology (LT), and as an API ― a set of web services for the integration into third-party applications. The ultimate goal of Tezaurs is to be the central computational lexicon for Latvian, bringing together all Latvian words and frequently used multi-word units and allowing for the integration of other LT resources and tools.