Exploring sentence informativeness

Syrielle Montariol, Aina Garí Soler, Alexandre Allauzen


Abstract
This study is a preliminary exploration of the concept of informativeness –how much information a sentence gives about a word it contains– and its potential benefits to building quality word representations from scarce data. We propose several sentence-level classifiers to predict informativeness, and we perform a manual annotation on a set of sentences. We conclude that these two measures correspond to different notions of informativeness. However, our experiments show that using the classifiers’ predictions to train word embeddings has an impact on embedding quality.
Anthology ID:
2019.jeptalnrecital-court.16
Volume:
Actes de la Conférence sur le Traitement Automatique des Langues Naturelles (TALN) PFIA 2019. Volume II : Articles courts
Month:
7
Year:
2019
Address:
Toulouse, France
Venue:
JEP/TALN/RECITAL
SIG:
Publisher:
ATALA
Note:
Pages:
303–312
Language:
URL:
https://aclanthology.org/2019.jeptalnrecital-court.16
DOI:
Bibkey:
Cite (ACL):
Syrielle Montariol, Aina Garí Soler, and Alexandre Allauzen. 2019. Exploring sentence informativeness. In Actes de la Conférence sur le Traitement Automatique des Langues Naturelles (TALN) PFIA 2019. Volume II : Articles courts, pages 303–312, Toulouse, France. ATALA.
Cite (Informal):
Exploring sentence informativeness (Montariol et al., JEP/TALN/RECITAL 2019)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingestion-script-update/2019.jeptalnrecital-court.16.pdf