<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="ross-etal-2018-grounding">
    <titleInfo>
        <title>Grounding language acquisition by training semantic parsers using captioned videos</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Candace</namePart>
        <namePart type="family">Ross</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Andrei</namePart>
        <namePart type="family">Barbu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Yevgeni</namePart>
        <namePart type="family">Berzak</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Battushig</namePart>
        <namePart type="family">Myanganbayar</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Boris</namePart>
        <namePart type="family">Katz</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2018-oct&quot;-&quot;nov</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Brussels, Belgium</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We develop a semantic parser that is trained in a grounded setting using pairs of videos captioned with sentences. This setting is both data-efficient, requiring little annotation, and similar to the experience of children where they observe their environment and listen to speakers. The semantic parser recovers the meaning of English sentences despite not having access to any annotated sentences. It does so despite the ambiguity inherent in vision where a sentence may refer to any combination of objects, object properties, relations or actions taken by any agent in a video. For this task, we collected a new dataset for grounded language acquisition. Learning a grounded semantic parser — turning sentences into logical forms using captioned videos — can significantly expand the range of data that parsers can be trained on, lower the effort of training a semantic parser, and ultimately lead to a better understanding of child language acquisition.</abstract>
    <identifier type="citekey">ross-etal-2018-grounding</identifier>
    <identifier type="doi">10.18653/v1/D18-1285</identifier>
    <location>
        <url>https://aclanthology.org/D18-1285</url>
    </location>
    <part>
        <date>2018-oct&quot;-&quot;nov</date>
        <extent unit="page">
            <start>2647</start>
            <end>2656</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Grounding language acquisition by training semantic parsers using captioned videos
%A Ross, Candace
%A Barbu, Andrei
%A Berzak, Yevgeni
%A Myanganbayar, Battushig
%A Katz, Boris
%S Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing
%D 2018
%8 oct" "nov
%I Association for Computational Linguistics
%C Brussels, Belgium
%F ross-etal-2018-grounding
%X We develop a semantic parser that is trained in a grounded setting using pairs of videos captioned with sentences. This setting is both data-efficient, requiring little annotation, and similar to the experience of children where they observe their environment and listen to speakers. The semantic parser recovers the meaning of English sentences despite not having access to any annotated sentences. It does so despite the ambiguity inherent in vision where a sentence may refer to any combination of objects, object properties, relations or actions taken by any agent in a video. For this task, we collected a new dataset for grounded language acquisition. Learning a grounded semantic parser — turning sentences into logical forms using captioned videos — can significantly expand the range of data that parsers can be trained on, lower the effort of training a semantic parser, and ultimately lead to a better understanding of child language acquisition.
%R 10.18653/v1/D18-1285
%U https://aclanthology.org/D18-1285
%U https://doi.org/10.18653/v1/D18-1285
%P 2647-2656

Markdown (Informal)

[Grounding language acquisition by training semantic parsers using captioned videos](https://aclanthology.org/D18-1285) (Ross et al., EMNLP 2018)

• Grounding language acquisition by training semantic parsers using captioned videos (Ross et al., EMNLP 2018)

ACL

• Candace Ross, Andrei Barbu, Yevgeni Berzak, Battushig Myanganbayar, and Boris Katz. 2018. Grounding language acquisition by training semantic parsers using captioned videos. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, pages 2647–2656, Brussels, Belgium. Association for Computational Linguistics.