@inproceedings{miotto-etal-2022-gpt,
    title = "Who is {GPT}-3? An exploration of personality, values and demographics",
    author = "Miotto, Maril{\`u}  and
      Rossberg, Nicola  and
      Kleinberg, Bennett",
    editor = "Bamman, David  and
      Hovy, Dirk  and
      Jurgens, David  and
      Keith, Katherine  and
      O'Connor, Brendan  and
      Volkova, Svitlana",
    booktitle = "Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science (NLP+CSS)",
    month = nov,
    year = "2022",
    address = "Abu Dhabi, UAE",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest-emnlp/2022.nlpcss-1.24/",
    doi = "10.18653/v1/2022.nlpcss-1.24",
    pages = "218--227",
    abstract = "Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa."
}