@inproceedings{spousta-etal-2008-victor,
    title = "Victor: the Web-Page Cleaning Tool",
    author = "Spousta, Miroslav  and
      Marek, Michal  and
      Pecina, Pavel",
    editor = "Evert, Stefan  and
      Kilgarriff, Adam  and
      Sharoff, Serge",
    booktitle = "Proceedings of the 4th Web as Corpus Workshop",
    month = jun,
    year = "2008",
    address = "Marrakech, Morocco",
    publisher = "European Language Resources Association",
    url = "https://preview.aclanthology.org/fix-sig-urls/2008.wac-1.3/",
    pages = "12--17",
    abstract = "In this paper we present a complete solution for automatic cleaning of arbitrary HTML pages with a goal of using web data as a corpus in the area of natural language processing, computational linguistics. We employ a sequence-labeling approach based on Conditional Random Fields (CRF). Every block of text in analyzed web page is assigned a set of features extracted from the textual content, HTML structure of the page. The blocks are automatically labeled either as content segments containing main web page content, which should be preserved, or as noisy segments not suitable for further linguistic processing, which should be eliminated. Our solution is based on the tool introduced at the CLEANEVAL 2007 shared task workshop. In this paper, we present new CRF features, a handy annotation tool{\quotedblbase} new evaluation metrics. Evaluation itself is performed on a random sample of web pages automatically downloaded from the Czech web domain."
}