@inproceedings{pierrejean-tanguy-2018-towards,
    title = "Towards Qualitative Word Embeddings Evaluation: Measuring Neighbors Variation",
    author = "Pierrejean, B{\'e}n{\'e}dicte  and
      Tanguy, Ludovic",
    editor = "Cordeiro, Silvio Ricardo  and
      Oraby, Shereen  and
      Pavalanathan, Umashanthi  and
      Rim, Kyeongmin",
    booktitle = "Proceedings of the 2018 Conference of the North {A}merican Chapter of the Association for Computational Linguistics: Student Research Workshop",
    month = jun,
    year = "2018",
    address = "New Orleans, Louisiana, USA",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/N18-4005/",
    doi = "10.18653/v1/N18-4005",
    pages = "32--39",
    abstract = "We propose a method to study the variation lying between different word embeddings models trained with different parameters. We explore the variation between models trained with only one varying parameter by observing the distributional neighbors variation and show how changing only one parameter can have a massive impact on a given semantic space. We show that the variation is not affecting all words of the semantic space equally. Variation is influenced by parameters such as setting a parameter to its minimum or maximum value but it also depends on the corpus intrinsic features such as the frequency of a word. We identify semantic classes of words remaining stable across the models trained and specific words having high variation."
}