<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="fujinuma-grissom-ii-2017-substring">
    <titleInfo>
        <title>Substring Frequency Features for Segmentation of Japanese Katakana Words with Unlabeled Corpora</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Yoshinari</namePart>
        <namePart type="family">Fujinuma</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Alvin</namePart>
        <namePart type="family">Grissom II</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2017-nov</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers)</title>
        </titleInfo>
        <originInfo>
            <publisher>Asian Federation of Natural Language Processing</publisher>
            <place>
                <placeTerm type="text">Taipei, Taiwan</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Word segmentation is crucial in natural language processing tasks for unsegmented languages. In Japanese, many out-of-vocabulary words appear in the phonetic syllabary katakana, making segmentation more difficult due to the lack of clues found in mixed script settings. In this paper, we propose a straightforward approach based on a variant of tf-idf and apply it to the problem of word segmentation in Japanese. Even though our method uses only an unlabeled corpus, experimental results show that it achieves performance comparable to existing methods that use manually labeled corpora. Furthermore, it improves performance of simple word segmentation models trained on a manually labeled corpus.</abstract>
    <identifier type="citekey">fujinuma-grissom-ii-2017-substring</identifier>
    <location>
        <url>https://aclanthology.org/I17-2013</url>
    </location>
    <part>
        <date>2017-nov</date>
        <extent unit="page">
            <start>74</start>
            <end>79</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Substring Frequency Features for Segmentation of Japanese Katakana Words with Unlabeled Corpora
%A Fujinuma, Yoshinari
%A Grissom II, Alvin
%S Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers)
%D 2017
%8 nov
%I Asian Federation of Natural Language Processing
%C Taipei, Taiwan
%F fujinuma-grissom-ii-2017-substring
%X Word segmentation is crucial in natural language processing tasks for unsegmented languages. In Japanese, many out-of-vocabulary words appear in the phonetic syllabary katakana, making segmentation more difficult due to the lack of clues found in mixed script settings. In this paper, we propose a straightforward approach based on a variant of tf-idf and apply it to the problem of word segmentation in Japanese. Even though our method uses only an unlabeled corpus, experimental results show that it achieves performance comparable to existing methods that use manually labeled corpora. Furthermore, it improves performance of simple word segmentation models trained on a manually labeled corpus.
%U https://aclanthology.org/I17-2013
%P 74-79

Markdown (Informal)

[Substring Frequency Features for Segmentation of Japanese Katakana Words with Unlabeled Corpora](https://aclanthology.org/I17-2013) (Fujinuma & Grissom II, IJCNLP 2017)

• Substring Frequency Features for Segmentation of Japanese Katakana Words with Unlabeled Corpora (Fujinuma & Grissom II, IJCNLP 2017)

ACL

• Yoshinari Fujinuma and Alvin Grissom II. 2017. Substring Frequency Features for Segmentation of Japanese Katakana Words with Unlabeled Corpora. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 74–79, Taipei, Taiwan. Asian Federation of Natural Language Processing.