How Do Lexical Senses Correspond Between Spoken German and German Sign Language?

Melis Çelikkol, Wei Zhao


Abstract
Sign language lexicographers construct bilingual dictionaries by establishing word-to-sign mappings, where polysemous and homonymous words corresponding to different signs across contexts are often underrepresented. A usage-based approach examining how word senses map to signs can identify such novel mappings absent from current dictionaries, enriching lexicographic resources.We address this by analyzing German and German Sign Language (Deutsche Gebärdensprache, DGS), manually annotating 1,404 word use–to–sign ID mappings derived from 32 words from the German Word Usage Graph (D-WUG) and 49 signs from the Digital Dictionary of German Sign Language (DW-DGS). We identify three correspondence types: Type 1 (one-to-many), Type 2 (many-to-one), and Type 3 (one-to-one), plus No Match cases. We evaluate computational methods: Exact Match (EM) and Semantic Similarity (SS) using SBERT embeddings. SS substantially outperforms EM overall 88.52% vs. 71.31%), with dramatic gains for Type 1 (+52.1 pp). Our work establishes the first annotated dataset for cross-modal sense correspondence and reveals which correspondence patterns are computationally tractable.Our code and dataset are made publicly available
Anthology ID:
2026.eacl-srw.54
Volume:
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 4: Student Research Workshop)
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Selene Baez Santamaria, Sai Ashish Somayajula, Atsuki Yamaguchi
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
735–746
Language:
URL:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-srw.54/
DOI:
Bibkey:
Cite (ACL):
Melis Çelikkol and Wei Zhao. 2026. How Do Lexical Senses Correspond Between Spoken German and German Sign Language?. In Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 4: Student Research Workshop), pages 735–746, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
How Do Lexical Senses Correspond Between Spoken German and German Sign Language? (Çelikkol & Zhao, EACL 2026)
Copy Citation:
PDF:
https://preview.aclanthology.org/ingest-eacl/2026.eacl-srw.54.pdf
Attachment:
 2026.eacl-srw.54.attachment.zip