@inproceedings{nedumpozhimana-kelleher-2021-finding,
    title = "Finding {BERT}{'}s Idiomatic Key",
    author = "Nedumpozhimana, Vasudevan  and
      Kelleher, John",
    editor = "Cook, Paul  and
      Mitrovi{\'c}, Jelena  and
      Escart{\'i}n, Carla Parra  and
      Vaidya, Ashwini  and
      Osenova, Petya  and
      Taslimipoor, Shiva  and
      Ramisch, Carlos",
    booktitle = "Proceedings of the 17th Workshop on Multiword Expressions (MWE 2021)",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2021.mwe-1.7/",
    doi = "10.18653/v1/2021.mwe-1.7",
    pages = "57--62",
    abstract = "Sentence embeddings encode information relating to the usage of idioms in a sentence. This paper reports a set of experiments that combine a probing methodology with input masking to analyse where in a sentence this idiomatic information is taken from, and what form it takes. Our results indicate that BERT{'}s idiomatic key is primarily found within an idiomatic expression, but also draws on information from the surrounding context. Also, BERT can distinguish between the disruption in a sentence caused by words missing and the incongruity caused by idiomatic usage."
}