Investigating Rich Feature Sources for Conceptual Representation Encoding

Lu Cao, Yulong Chen, Dandan Huang, Yue Zhang


Abstract
Functional Magnetic Resonance Imaging (fMRI) provides a means to investigate human conceptual representation in cognitive and neuroscience studies, where researchers predict the fMRI activations with elicited stimuli inputs. Previous work mainly uses a single source of features, particularly linguistic features, to predict fMRI activations. However, relatively little work has been done on investigating rich-source features for conceptual representation. In this paper, we systematically compare the linguistic, visual as well as auditory input features in conceptual representation, and further introduce associative conceptual features, which are obtained from Small World of Words game, to predict fMRI activations. Our experimental results show that those rich-source features can enhance performance in predicting the fMRI activations. Our analysis indicates that information from rich sources is present in the conceptual representation of human brains. In particular, the visual feature weights the most on conceptual representation, which is consistent with the recent cognitive science study.
Anthology ID:
2020.cogalex-1.2
Volume:
Proceedings of the Workshop on the Cognitive Aspects of the Lexicon
Month:
December
Year:
2020
Address:
Online
Venue:
CogALex
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
12–22
Language:
URL:
https://aclanthology.org/2020.cogalex-1.2
DOI:
Bibkey:
Cite (ACL):
Lu Cao, Yulong Chen, Dandan Huang, and Yue Zhang. 2020. Investigating Rich Feature Sources for Conceptual Representation Encoding. In Proceedings of the Workshop on the Cognitive Aspects of the Lexicon, pages 12–22, Online. Association for Computational Linguistics.
Cite (Informal):
Investigating Rich Feature Sources for Conceptual Representation Encoding (Cao et al., CogALex 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/emnlp-22-attachments/2020.cogalex-1.2.pdf
Data
ImageNet