Learning to Learn Semantic Factors in Heterogeneous Image Classification

Boyue Fan, Zhenting Liu


Abstract
Few-shot learning is to recognize novel classes with a few labeled samples per class. Although numerous meta-learning methods have made significant progress, they struggle to directly address the heterogeneity of training and evaluating task distributions, resulting in the domain shift problem when transitioning to new tasks with disjoint spaces. In this paper, we propose a novel method to deal with the heterogeneity. Specifically, by simulating class-difference domain shift during the meta-train phase, a bilevel optimization procedure is applied to learn a transferable representation space that can rapidly adapt to heterogeneous tasks. Experiments demonstrate the effectiveness of our proposed method.
Anthology ID:
2021.alvr-1.6
Volume:
Proceedings of the Second Workshop on Advances in Language and Vision Research
Month:
June
Year:
2021
Address:
Online
Editors:
Xin, Ronghang Hu, Drew Hudson, Tsu-Jui Fu, Marcus Rohrbach, Daniel Fried
Venue:
ALVR
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
34–38
Language:
URL:
https://aclanthology.org/2021.alvr-1.6
DOI:
10.18653/v1/2021.alvr-1.6
Bibkey:
Cite (ACL):
Boyue Fan and Zhenting Liu. 2021. Learning to Learn Semantic Factors in Heterogeneous Image Classification. In Proceedings of the Second Workshop on Advances in Language and Vision Research, pages 34–38, Online. Association for Computational Linguistics.
Cite (Informal):
Learning to Learn Semantic Factors in Heterogeneous Image Classification (Fan & Liu, ALVR 2021)
Copy Citation:
PDF:
https://preview.aclanthology.org/nschneid-patch-4/2021.alvr-1.6.pdf
Data
CUB-200-2011mini-Imagenet