<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="lu-etal-2021-sf">
    <titleInfo>
        <title>SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Xiaopeng</namePart>
        <namePart type="family">Lu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kyusong</namePart>
        <namePart type="family">Lee</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Tiancheng</namePart>
        <namePart type="family">Zhao</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-apr</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Although open-domain question answering (QA) draws great attention in recent years, it requires large amounts of resources for building the full system and it is often difficult to reproduce previous results due to complex configurations. In this paper, we introduce SF-QA: simple and fair evaluation framework for open-domain QA. SF-QA framework modularizes the pipeline open-domain QA system, which makes the task itself easily accessible and reproducible to research groups without enough computing resources. The proposed evaluation framework is publicly available and anyone can contribute to the code and evaluations.</abstract>
    <identifier type="citekey">lu-etal-2021-sf</identifier>
    <identifier type="doi">10.18653/v1/2021.eacl-demos.2</identifier>
    <location>
        <url>https://aclanthology.org/2021.eacl-demos.2</url>
    </location>
    <part>
        <date>2021-apr</date>
        <extent unit="page">
            <start>7</start>
            <end>13</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering
%A Lu, Xiaopeng
%A Lee, Kyusong
%A Zhao, Tiancheng
%S Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations
%D 2021
%8 apr
%I Association for Computational Linguistics
%C Online
%F lu-etal-2021-sf
%X Although open-domain question answering (QA) draws great attention in recent years, it requires large amounts of resources for building the full system and it is often difficult to reproduce previous results due to complex configurations. In this paper, we introduce SF-QA: simple and fair evaluation framework for open-domain QA. SF-QA framework modularizes the pipeline open-domain QA system, which makes the task itself easily accessible and reproducible to research groups without enough computing resources. The proposed evaluation framework is publicly available and anyone can contribute to the code and evaluations.
%R 10.18653/v1/2021.eacl-demos.2
%U https://aclanthology.org/2021.eacl-demos.2
%U https://doi.org/10.18653/v1/2021.eacl-demos.2
%P 7-13

Markdown (Informal)

[SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering](https://aclanthology.org/2021.eacl-demos.2) (Lu et al., EACL 2021)

• SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering (Lu et al., EACL 2021)

ACL

• Xiaopeng Lu, Kyusong Lee, and Tiancheng Zhao. 2021. SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, pages 7–13, Online. Association for Computational Linguistics.