Word Sense Inventories by Non-Experts.
Anna Rumshisky, Nick Botchan, Sophie Kushkuley, James Pustejovsky
Abstract
In this paper, we explore different strategies for implementing a crowdsourcing methodology for a single-step construction of an empirically-derived sense inventory and the corresponding sense-annotated corpus. We report on the crowdsourcing experiments using implementation strategies with different HIT costs, worker qualification testing, and other restrictions. We describe multiple adjustments required to ensure successful HIT design, given significant changes within the crowdsourcing community over the last three years.- Anthology ID:
- L12-1603
- Volume:
- Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12)
- Month:
- May
- Year:
- 2012
- Address:
- Istanbul, Turkey
- Editors:
- Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, Stelios Piperidis
- Venue:
- LREC
- SIG:
- Publisher:
- European Language Resources Association (ELRA)
- Note:
- Pages:
- 4055–4059
- Language:
- URL:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/1014_Paper.pdf
- DOI:
- Cite (ACL):
- Anna Rumshisky, Nick Botchan, Sophie Kushkuley, and James Pustejovsky. 2012. Word Sense Inventories by Non-Experts.. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC'12), pages 4055–4059, Istanbul, Turkey. European Language Resources Association (ELRA).
- Cite (Informal):
- Word Sense Inventories by Non-Experts. (Rumshisky et al., LREC 2012)
- PDF:
- http://www.lrec-conf.org/proceedings/lrec2012/pdf/1014_Paper.pdf