@inproceedings{pahuja-etal-2019-structure,
    title = "Structure Learning for Neural Module Networks",
    author = "Pahuja, Vardaan  and
      Fu, Jie  and
      Chandar, Sarath  and
      Pal, Christopher",
    editor = "Mogadala, Aditya  and
      Klakow, Dietrich  and
      Pezzelle, Sandro  and
      Moens, Marie-Francine",
    booktitle = "Proceedings of the Beyond Vision and LANguage: inTEgrating Real-world kNowledge (LANTERN)",
    month = nov,
    year = "2019",
    address = "Hong Kong, China",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/D19-6401",
    doi = "10.18653/v1/D19-6401",
    pages = "1--10",
    abstract = "Neural Module Networks, originally proposed for the task of visual question answering, are a class of neural network architectures that involve human-specified neural modules, each designed for a specific form of reasoning. In current formulations of such networks only the parameters of the neural modules and/or the order of their execution is learned. In this work, we further expand this approach and also learn the underlying internal structure of modules in terms of the ordering and combination of simple and elementary arithmetic operators. We utilize a minimum amount of prior knowledge from the human-specified neural modules in the form of different input types and arithmetic operators used in these modules. Our results show that one is indeed able to simultaneously learn both internal module structure and module sequencing without extra supervisory signals for module execution sequencing. With this approach, we report performance comparable to models using hand-designed modules. In addition, we do a analysis of sensitivity of the learned modules w.r.t. the arithmetic operations and infer the analytical expressions of the learned modules.",
}