Deep voice-visual cross-modal retrieval with deep feature similarity learning | |
Chen, Yaxiong1,2; Lu, Xiaoqiang1; Feng, Yachuang1 | |
2019 | |
会议名称 | 2nd Chinese Conference on Pattern Recognition and Computer Vision, PRCV 2019 |
会议录名称 | Pattern Recognition and Computer Vision- 2nd Chinese Conference, PRCV 2019, Proceedings, Part III |
卷号 | 11859 LNCS |
页码 | 454-465 |
会议日期 | 2019-11-08 |
会议地点 | Xi'an, China |
出版者 | Springer |
产权排序 | 1 |
摘要 | Thanks to the development of deep learning, voice-visual cross-modal retrieval has made remarkable progress in recent years. However, there still exist some bottlenecks: How to establish effective correlation between voices and images to improve the retrieval precision and how to reduce data storage and speed up retrieval in large-scale crossmodal data. In this paper, we propose a novel Voice-Visual Cross-Modal Hashing (V2CMH) method, which can generate hash codes with low storage memory and fast retrieval properties. Specially, the proposed V2CMH method can leverage deep feature similarity to establish the semantic relationship between voices and images. In addition, for hash codes learning, our method attempts to preserve the semantic similarity of binary codes and reduce the information loss of binary codes generation. Experiments illustrate that V2CMH algorithm can achieve better retrieval performance than other state-of-the-art cross-modal retrieval algorithms. © Springer Nature Switzerland AG 2019. |
关键词 | Cross-modal retrieval Deep hashing Deep feature similarity |
作者部门 | 光谱成像技术研究室 |
DOI | 10.1007/978-3-030-31726-3_39 |
收录类别 | EI |
ISBN号 | 9783030317256 |
语种 | 英语 |
ISSN号 | 03029743;16113349 |
EI入藏号 | 20202008650109 |
引用统计 | |
文献类型 | 会议论文 |
条目标识符 | http://ir.opt.ac.cn/handle/181661/93551 |
专题 | 光谱成像技术研究室 |
通讯作者 | Lu, Xiaoqiang |
作者单位 | 1.The Key Laboratory of Spectral Imaging Technology CAS, Xian Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xian; 710119, China; 2.University of Chinese Academy of Sciences, Beijing; 100049, China |
推荐引用方式 GB/T 7714 | Chen, Yaxiong,Lu, Xiaoqiang,Feng, Yachuang. Deep voice-visual cross-modal retrieval with deep feature similarity learning[C]:Springer,2019:454-465. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Deep voice-visual cr(563KB) | 会议论文 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论