@inproceedings{lappin-bernardy-2022-neural,
    title = "A Neural Model for Compositional Word Embeddings and Sentence Processing",
    author = "Lappin, Shalom  and
      Bernardy, Jean-Philippe",
    editor = "Chersoni, Emmanuele  and
      Hollenstein, Nora  and
      Jacobs, Cassandra  and
      Oseki, Yohei  and
      Pr{\'e}vot, Laurent  and
      Santus, Enrico",
    booktitle = "Proceedings of the Workshop on Cognitive Modeling and Computational Linguistics",
    month = may,
    year = "2022",
    address = "Dublin, Ireland",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2022.cmcl-1.2",
    doi = "10.18653/v1/2022.cmcl-1.2",
    pages = "12--22",
    abstract = "We propose a new neural model for word embeddings, which uses Unitary Matrices as the primary device for encoding lexical information. It uses simple matrix multiplication to derive matrices for large units, yielding a sentence processing model that is strictly compositional, does not lose information over time steps, and is transparent, in the sense that word embeddings can be analysed regardless of context. This model does not employ activation functions, and so the network is fully accessible to analysis by the methods of linear algebra at each point in its operation on an input sequence. We test it in two NLP agreement tasks and obtain rule like perfect accuracy, with greater stability than current state-of-the-art systems. Our proposed model goes some way towards offering a class of computationally powerful deep learning systems that can be fully understood and compared to human cognitive processes for natural language learning and representation.",
}