Transfer learning of feedback head expressions in Danish and Polish comparable multimodal corpora

Costanza Navarretta, Magdalena Lis


Abstract
The paper is an investigation of the reusability of the annotations of head movements in a corpus in a language to predict the feedback functions of head movements in a comparable corpus in another language. The two corpora consist of naturally occurring triadic conversations in Danish and Polish, which were annotated according to the same scheme. The intersection of common annotation features was used in the experiments. A Naïve Bayes classifier was trained on the annotations of a corpus and tested on the annotations of the other corpus. Training and test datasets were then reversed and the experiments repeated. The results show that the classifier identifies more feedback behaviours than the majority baseline in both cases and the improvements are significant. The performance of the classifier decreases significantly compared with the results obtained when training and test data belong to the same corpus. Annotating multimodal data is resource consuming, thus the results are promising. However, they also confirm preceding studies that have identified both similarities and differences in the use of feedback head movements in different languages. Since our datasets are small and only regard a communicative behaviour in two languages, the experiments should be tested on more data types.
Anthology ID:
L14-1436
Volume:
Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)
Month:
May
Year:
2014
Address:
Reykjavik, Iceland
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
3597–3603
Language:
URL:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/525_Paper.pdf
DOI:
Bibkey:
Cite (ACL):
Costanza Navarretta and Magdalena Lis. 2014. Transfer learning of feedback head expressions in Danish and Polish comparable multimodal corpora. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14), pages 3597–3603, Reykjavik, Iceland. European Language Resources Association (ELRA).
Cite (Informal):
Transfer learning of feedback head expressions in Danish and Polish comparable multimodal corpora (Navarretta & Lis, LREC 2014)
Copy Citation:
PDF:
http://www.lrec-conf.org/proceedings/lrec2014/pdf/525_Paper.pdf