@inproceedings{wang-jansen-2023-self,
    title = "Self-Supervised Behavior Cloned Transformers are Path Crawlers for Text Games",
    author = "Wang, Ruoyao  and
      Jansen, Peter",
    editor = "Bouamor, Houda  and
      Pino, Juan  and
      Bali, Kalika",
    booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2023",
    month = dec,
    year = "2023",
    address = "Singapore",
    publisher = "Association for Computational Linguistics",
    url = "https://preview.aclanthology.org/jlcl-multiple-ingestion/2023.findings-emnlp.369/",
    doi = "10.18653/v1/2023.findings-emnlp.369",
    pages = "5555--5565",
    abstract = "In this work, we introduce a self-supervised behavior cloning transformer for text games, which are challenging benchmarks for multi-step reasoning in virtual environments. Traditionally, Behavior Cloning Transformers excel in such tasks but rely on supervised training data. Our approach auto-generates training data by exploring trajectories (defined by common macro-action sequences) that lead to reward within the games, while determining the generality and utility of these trajectories by rapidly training small models then evalauating their performance on unseen development games. Through empirical analysis, we show our method consistently uncovers generalizable training data, achieving about 90{\%} performance of supervised systems across three benchmark text games."
}