<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="meaney-etal-2021-semeval">
    <titleInfo>
        <title>SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">J</namePart>
        <namePart type="given">A</namePart>
        <namePart type="family">Meaney</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Steven</namePart>
        <namePart type="family">Wilson</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Luis</namePart>
        <namePart type="family">Chiruzzo</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Adam</namePart>
        <namePart type="family">Lopez</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Walid</namePart>
        <namePart type="family">Magdy</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-aug</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>SemEval 2021 Task 7, HaHackathon, was the first shared task to combine the previously separate domains of humor detection and offense detection. We collected 10,000 texts from Twitter and the Kaggle Short Jokes dataset, and had each annotated for humor and offense by 20 annotators aged 18-70. Our subtasks were binary humor detection, prediction of humor and offense ratings, and a novel controversy task: to predict if the variance in the humor ratings was higher than a specific threshold. The subtasks attracted 36-58 submissions, with most of the participants choosing to use pre-trained language models. Many of the highest performing teams also implemented additional optimization techniques, including task-adaptive training and adversarial training. The results suggest that the participating systems are well suited to humor detection, but that humor controversy is a more challenging task. We discuss which models excel in this task, which auxiliary techniques boost their performance, and analyze the errors which were not captured by the best systems.</abstract>
    <identifier type="citekey">meaney-etal-2021-semeval</identifier>
    <identifier type="doi">10.18653/v1/2021.semeval-1.9</identifier>
    <location>
        <url>https://aclanthology.org/2021.semeval-1.9</url>
    </location>
    <part>
        <date>2021-aug</date>
        <extent unit="page">
            <start>105</start>
            <end>119</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense
%A Meaney, J. A.
%A Wilson, Steven
%A Chiruzzo, Luis
%A Lopez, Adam
%A Magdy, Walid
%S Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
%D 2021
%8 aug
%I Association for Computational Linguistics
%C Online
%F meaney-etal-2021-semeval
%X SemEval 2021 Task 7, HaHackathon, was the first shared task to combine the previously separate domains of humor detection and offense detection. We collected 10,000 texts from Twitter and the Kaggle Short Jokes dataset, and had each annotated for humor and offense by 20 annotators aged 18-70. Our subtasks were binary humor detection, prediction of humor and offense ratings, and a novel controversy task: to predict if the variance in the humor ratings was higher than a specific threshold. The subtasks attracted 36-58 submissions, with most of the participants choosing to use pre-trained language models. Many of the highest performing teams also implemented additional optimization techniques, including task-adaptive training and adversarial training. The results suggest that the participating systems are well suited to humor detection, but that humor controversy is a more challenging task. We discuss which models excel in this task, which auxiliary techniques boost their performance, and analyze the errors which were not captured by the best systems.
%R 10.18653/v1/2021.semeval-1.9
%U https://aclanthology.org/2021.semeval-1.9
%U https://doi.org/10.18653/v1/2021.semeval-1.9
%P 105-119

Markdown (Informal)

[SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense](https://aclanthology.org/2021.semeval-1.9) (Meaney et al., SemEval 2021)

• SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense (Meaney et al., SemEval 2021)

ACL

• J. A. Meaney, Steven Wilson, Luis Chiruzzo, Adam Lopez, and Walid Magdy. 2021. SemEval 2021 Task 7: HaHackathon, Detecting and Rating Humor and Offense. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 105–119, Online. Association for Computational Linguistics.