Collect and select: Semantic alignment metric learning for few-shot learning | |
Hao, Fusheng1,2; He, Fengxiang3; Cheng, Jun1,2; Wang, Lei1,2; Cao, Jianzhong4![]() ![]() | |
2019-12 | |
会议名称 | 17th IEEE/CVF International Conference on Computer Vision, ICCV 2019 |
会议录名称 | Proceedings - 2019 International Conference on Computer Vision, ICCV 2019 |
卷号 | 2019-October |
页码 | 8459-8468 |
会议日期 | 2019-10-27 |
会议地点 | Seoul, Korea, Republic of |
出版者 | Institute of Electrical and Electronics Engineers Inc. |
产权排序 | 4 |
摘要 | Few-shot learning aims to learn latent patterns from few training examples and has shown promises in practice. However, directly calculating the distances between the query image and support image in existing methods may cause ambiguity because dominant objects can locate anywhere on images. To address this issue, this paper proposes a Semantic Alignment Metric Learning (SAML) method for few-shot learning that aligns the semantically relevant dominant objects through a ''collect-and-select'' strategy. Specifically, we first calculate a relation matrix (RM) to ''collect' the distances of each local region pairs of the 3D tensor extracted from a query image and the mean tensor of the support images. Then, the attention technique is adapted to ''select' the semantically relevant pairs and put more weights on them. Afterwards, a multi-layer perceptron (MLP) is utilized to map the reweighted RMs to their corresponding similarity scores. Theoretical analysis demonstrates the generalization ability of SAML and gives a theoretical guarantee. Empirical results demonstrate that semantic alignment is achieved. Extensive experiments on benchmark datasets validate the strengths of the proposed approach and demonstrate that SAML significantly outperforms the current state-of-the-art methods. The source code is available at https://github.com/haofusheng/SAML. © 2019 IEEE. |
作者部门 | 飞行器光学成像与测量技术研究室 |
DOI | 10.1109/ICCV.2019.00855 |
收录类别 | EI ; CPCI |
ISBN号 | 9781728148038 |
语种 | 英语 |
ISSN号 | 15505499 |
WOS记录号 | WOS:000548549203058 |
EI入藏号 | 20201208327056 |
引用统计 | |
文献类型 | 会议论文 |
条目标识符 | http://ir.opt.ac.cn/handle/181661/93337 |
专题 | 飞行器光学成像与测量技术研究室 |
作者单位 | 1.CAS Key Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institutes of Advanced Technology, CAS, China; 2.Chinese University of Hong Kong, Hong Kong, Hong Kong; 3.UBTECH Sydney AI Centre, School of Computer Science, Faculty of Engineering, University of Sydney, Darlington; NSW; 2008, Australia; 4.Xi'An Institute of Optics and Precision Mechanics, CAS, China |
推荐引用方式 GB/T 7714 | Hao, Fusheng,He, Fengxiang,Cheng, Jun,et al. Collect and select: Semantic alignment metric learning for few-shot learning[C]:Institute of Electrical and Electronics Engineers Inc.,2019:8459-8468. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Collect and select S(591KB) | 会议论文 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论