The Language of Brain Signals: Natural Language Processing of Electroencephalography Reports

Ramon Maldonado, Sanda Harabagiu


Abstract
Brain signals are captured by clinical electroencephalography (EEG) which is an excellent tool for probing neural function. When EEG tests are performed, a textual EEG report is generated by the neurologist to document the findings, thus using language that describes the brain signals and its clinical correlations. Even with the impetus provided by the BRAIN initiative (brainitititive.nih.gov), there are no annotations available in texts that capture language describing the brain activities and their correlations with various pathologies. In this paper we describe an annotation effort carried out on a large corpus of EEG reports, providing examples of EEG-specific and clinically relevant concepts. In addition, we detail our annotation schema for brain signal attributes. We also discuss the resulting annotation of long-distance relations between concepts in EEG reports. By exemplifying a self-attention joint-learning to predict similar annotations in the EEG report corpus, we discuss the promising results, hoping that our effort will inform the design of novel knowledge capture techniques that will include the language of brain signals.
Anthology ID:
2020.lrec-1.276
Volume:
Proceedings of the 12th Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
2268–2275
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.276
DOI:
Bibkey:
Cite (ACL):
Ramon Maldonado and Sanda Harabagiu. 2020. The Language of Brain Signals: Natural Language Processing of Electroencephalography Reports. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 2268–2275, Marseille, France. European Language Resources Association.
Cite (Informal):
The Language of Brain Signals: Natural Language Processing of Electroencephalography Reports (Maldonado & Harabagiu, LREC 2020)
Copy Citation:
PDF:
https://preview.aclanthology.org/update-css-js/2020.lrec-1.276.pdf