@inproceedings{nishimura-etal-2019-procedural,
    title = "Procedural Text Generation from a Photo Sequence",
    author = "Nishimura, Taichi  and
      Hashimoto, Atsushi  and
      Mori, Shinsuke",
    editor = "van Deemter, Kees  and
      Lin, Chenghua  and
      Takamura, Hiroya",
    booktitle = "Proceedings of the 12th International Conference on Natural Language Generation",
    month = oct # "–" # nov,
    year = "2019",
    address = "Tokyo, Japan",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/ingest_wac_2008/W19-8650/",
    doi = "10.18653/v1/W19-8650",
    pages = "409--414",
    abstract = "Multimedia procedural texts, such as instructions and manuals with pictures, support people to share how-to knowledge. In this paper, we propose a method for generating a procedural text given a photo sequence allowing users to obtain a multimedia procedural text. We propose a single embedding space both for image and text enabling to interconnect them and to select appropriate words to describe a photo. We implemented our method and tested it on cooking instructions, i.e., recipes. Various experimental results showed that our method outperforms standard baselines."
}