@inproceedings{guan-etal-2026-sacred,
    title = "{SACRED}: A Faithful Annotated Multimedia Multimodal Multilingual Dataset for Classifying Connectedness Types in Online Spirituality",
    author = "Guan, Qinghao  and
      Pan, Yuchen  and
      Li, Donghao  and
      Zhang, Zishi  and
      Chen, Yiyang  and
      Li, Lu  and
      Canu, Flaminia  and
      Volkart, Emilia  and
      Schneider, Gerold",
    editor = "Montejo-Raez, Arturo  and
      Grisot, Cristina  and
      Blochowiak, Joanna  and
      Ljube{\v{s}}i{\'c}, Nikola  and
      Battaner, Elena  and
      Rigau, German",
    booktitle = "Proceedings of Shaping Multilingual, Multimodal {AI} for the Social Sciences and Humanities ({LLM}s4{SSH}) @ {LREC} 2026",
    month = may,
    year = "2026",
    address = "Palma de Mallorca (Spain)",
    publisher = "ELRA Language Resources Association (ELRA)",
    url = "https://preview.aclanthology.org/ingest-lrec/2026.llms4ssh-1.13/",
    doi = "10.63317/5h8po3qfcqa9",
    pages = "126--138",
    abstract = "In religion and theology studies, spirituality has garnered significant research attention for the reason that it not only transcends culture but offers unique experience to each individual. However, social scientists often rely on limited datasets, which are basically unavailable online. In this study, we collaborated with social scientists to develop a high-quality multimedia multi-modal datasets, \textbf{SACRED}, in which the faithfulness of classification is guaranteed. Using \textbf{SACRED}, we evaluated the performance of 13 popular LLMs as well as traditional rule-based and fine-tuned approaches. The result suggests DeepSeek-V3 model performs well in classifying such abstract concepts (i.e., 79.19{\%} accuracy in the Quora test set), and the GPT-4o-mini model surpassed the other models in the vision tasks (63.99{\%} F1 score). Purportedly, this is the first annotated multi-modal dataset from online spirituality communication. Our study also found a new type of connectedness which is valuable for communication science studies."
}