Transductive zero-shot learning via knowledge graph and graph convolutional networks

基于知识图谱和图卷积网络的转导式零样本学习

阅读:1

Abstract

Zero-shot learning methods are used to recognize objects of unseen categories. By transferring knowledge from the seen classes to describe the unseen classes, deep learning models can recognize unseen categories. However, relying solely on a small labeled seen dataset and the limited semantic relationships will lead to a significant domain shift, hindering the classification performance. To tackle this problem, we propose a transductive zero-shot learning method, based on Knowledge Graph and Graph Convolutional Network. We firstly learn a knowledge graph, where each node represents a category encoded by its semantic embedding. With a shallow graph convolutional network having a small number of layers, we learn the classifier for each category, supervised by the visual classifiers of the seen categories. During testing, a clustering strategy, the Double Filter Module with Hungarian algorithm, is applied to the unseen samples, and then, the learned classifiers are used to predict their categories. Pseudo annotations are given to the samples that are more accurately classified. In the transductive setting, the unseen categories with higher classification accuracy are assigned pseudo annotations, and can be associated with the seen categories to progressively update model parameters. We validate the proposed model on three data sets, and our model outperforms other state-of-the-art methods, achieving 47.36% accuracy on AWA2, 30.69% on ImageNet50, and 18.87 on ImageNet100, with a 4-10% improvement over existing methods.

特别声明

1、本页面内容包含部分的内容是基于公开信息的合理引用;引用内容仅为补充信息,不代表本站立场。

2、若认为本页面引用内容涉及侵权,请及时与本站联系,我们将第一时间处理。

3、其他媒体/个人如需使用本页面原创内容,需注明“来源:[生知库]”并获得授权;使用引用内容的,需自行联系原作者获得许可。

4、投稿及合作请联系:info@biocloudy.com。