@inproceedings{maeda-etal-2024-decomposing,
    title = "Decomposing Co-occurrence Matrices into Interpretable Components as Formal Concepts",
    author = "Maeda, Akihiro  and
      Torii, Takuma  and
      Hidaka, Shohei",
    editor = "Ku, Lun-Wei  and
      Martins, Andre  and
      Srikumar, Vivek",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2024",
    month = aug,
    year = "2024",
    address = "Bangkok, Thailand",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2024.findings-acl.278/",
    doi = "10.18653/v1/2024.findings-acl.278",
    pages = "4683--4700",
    abstract = "This study addresses the interpretability of word representations through an investigation of a count-based co-occurrence matrix. Employing the mathematical methodology of Formal Concept Analysis, we reveal an underlying structure that is amenable to human interpretation. Furthermore, we unveil the emergence of hierarchical and geometrical structures within word vectors as consequences of word usage. Our experiments on the PPMI matrix demonstrate that the formal concepts that we identified align with interpretable categories, as shown in the category completion task."
}