Abstract
The study of emergent communication has long been devoted to coax neural network agents to learn a language sharing similar properties with human language. In this paper, we try to find a ‘natural’ way to help agents learn a compositional and symmetric language in complex settings like dialog games. Inspired by the theory that human language was originated from simple interactions, we hypothesize that language may evolve from simple tasks to difficult tasks. We propose a curriculum learning method called task transfer, and propose a novel architecture called symbolic mapping. We find that task transfer distinctly helps language learning in difficult tasks, and symbolic mapping promotes the effect. Further, we explore vocabulary expansion, and show that with the help of symbolic mapping, agents can easily learn to use new symbols when the environment becomes more complex. All in all, we find that a process from simplicity to complexity can serve as a natural way to help multi-agent language learning, and the proposed symbolic mapping is effective for this process.- Anthology ID:
- 2023.findings-acl.491
- Volume:
- Findings of the Association for Computational Linguistics: ACL 2023
- Month:
- July
- Year:
- 2023
- Address:
- Toronto, Canada
- Editors:
- Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
- Venue:
- Findings
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 7756–7770
- Language:
- URL:
- https://aclanthology.org/2023.findings-acl.491
- DOI:
- 10.18653/v1/2023.findings-acl.491
- Cite (ACL):
- Yicheng Feng and Zongqing Lu. 2023. Multi-Agent Language Learning: Symbolic Mapping. In Findings of the Association for Computational Linguistics: ACL 2023, pages 7756–7770, Toronto, Canada. Association for Computational Linguistics.
- Cite (Informal):
- Multi-Agent Language Learning: Symbolic Mapping (Feng & Lu, Findings 2023)
- PDF:
- https://preview.aclanthology.org/proper-vol2-ingestion/2023.findings-acl.491.pdf