@inproceedings{stekel-etal-2021-word,
    title = "Word Sense Induction with Attentive Context Clustering",
    author = "Stekel, Moshe  and
      Azaria, Amos  and
      Gordin, Shai",
    editor = {H{\"a}m{\"a}l{\"a}inen, Mika  and
      Alnajjar, Khalid  and
      Partanen, Niko  and
      Rueter, Jack},
    booktitle = "Proceedings of the Workshop on Natural Language Processing for Digital Humanities",
    month = dec,
    year = "2021",
    address = "NIT Silchar, India",
    publisher = "NLP Association of India (NLPAI)",
    url = "https://preview.aclanthology.org/Author-page-Marten-During-lu/2021.nlp4dh-1.17/",
    pages = "144--151",
    abstract = "In this paper, we present ACCWSI (Attentive Context Clustering WSI), a method for Word Sense Induction, suitable for languages with limited resources. Pretrained on a small corpus and given an ambiguous word (query word) and a set of excerpts that contain it, ACCWSI uses an attention mechanism for generating context-aware embeddings, distinguishing between the different senses assigned to the query word. These embeddings are then clustered to provide groups of main common uses of the query word. This method demonstrates practical applicability for shedding light on the meanings of ambiguous words in ancient languages, such as Classical Hebrew."
}