<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="bin-zia-etal-2018-urdu">
    <titleInfo>
        <title>Urdu Word Segmentation using Conditional Random Fields (CRFs)</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Haris</namePart>
        <namePart type="family">Bin Zia</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Agha</namePart>
        <namePart type="given">Ali</namePart>
        <namePart type="family">Raza</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Awais</namePart>
        <namePart type="family">Athar</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2018-aug</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 27th International Conference on Computational Linguistics</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Santa Fe, New Mexico, USA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>State-of-the-art Natural Language Processing algorithms rely heavily on efficient word segmentation. Urdu is amongst languages for which word segmentation is a complex task as it exhibits space omission as well as space insertion issues. This is partly due to the Arabic script which although cursive in nature, consists of characters that have inherent joining and non-joining attributes regardless of word boundary. This paper presents a word segmentation system for Urdu which uses a Conditional Random Field sequence modeler with orthographic, linguistic and morphological features. Our proposed model automatically learns to predict white space as word boundary as well as Zero Width Non-Joiner (ZWNJ) as sub-word boundary. Using a manually annotated corpus, our model achieves F1 score of 0.97 for word boundary identification and 0.85 for sub-word boundary identification tasks. We have made our code and corpus publicly available to make our results reproducible.</abstract>
    <identifier type="citekey">bin-zia-etal-2018-urdu</identifier>
    <location>
        <url>https://aclanthology.org/C18-1217</url>
    </location>
    <part>
        <date>2018-aug</date>
        <extent unit="page">
            <start>2562</start>
            <end>2569</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Urdu Word Segmentation using Conditional Random Fields (CRFs)
%A Bin Zia, Haris
%A Raza, Agha Ali
%A Athar, Awais
%S Proceedings of the 27th International Conference on Computational Linguistics
%D 2018
%8 aug
%I Association for Computational Linguistics
%C Santa Fe, New Mexico, USA
%F bin-zia-etal-2018-urdu
%X State-of-the-art Natural Language Processing algorithms rely heavily on efficient word segmentation. Urdu is amongst languages for which word segmentation is a complex task as it exhibits space omission as well as space insertion issues. This is partly due to the Arabic script which although cursive in nature, consists of characters that have inherent joining and non-joining attributes regardless of word boundary. This paper presents a word segmentation system for Urdu which uses a Conditional Random Field sequence modeler with orthographic, linguistic and morphological features. Our proposed model automatically learns to predict white space as word boundary as well as Zero Width Non-Joiner (ZWNJ) as sub-word boundary. Using a manually annotated corpus, our model achieves F1 score of 0.97 for word boundary identification and 0.85 for sub-word boundary identification tasks. We have made our code and corpus publicly available to make our results reproducible.
%U https://aclanthology.org/C18-1217
%P 2562-2569

Markdown (Informal)

[Urdu Word Segmentation using Conditional Random Fields (CRFs)](https://aclanthology.org/C18-1217) (Bin Zia et al., COLING 2018)

• Urdu Word Segmentation using Conditional Random Fields (CRFs) (Bin Zia et al., COLING 2018)

ACL

• Haris Bin Zia, Agha Ali Raza, and Awais Athar. 2018. Urdu Word Segmentation using Conditional Random Fields (CRFs). In Proceedings of the 27th International Conference on Computational Linguistics, pages 2562–2569, Santa Fe, New Mexico, USA. Association for Computational Linguistics.