OPT OpenIR  > 光谱成像技术研究室
Deep Binary Reconstruction for Cross-Modal Hashing
Hu, Di1; Nie, Feiping1; Li, Xuelong2,3,4
作者部门光谱成像技术研究室
2019-04
发表期刊IEEE TRANSACTIONS ON MULTIMEDIA
ISSN1520-9210;1941-0077
卷号21期号:4页码:973-985
产权排序4
摘要

To satisfy the huge storage space and organization capacity requirements in addressing big multimodal data, hashing techniques have been widely employed to learn binary representations in cross-modal retrieval tasks. However, optimizing the hashing objective under the necessary binary constraint is truly a difficult problem. A common strategy is to relax the constraint and perform individual binarizations over the learned real-valued representations. In this paper, in contrast to conventional two-stage methods, we propose to directly learn the binary codes, where the model can be easily optimized by a standard gradient descent optimizer. However, before that, we present a theoretical guarantee of the effectiveness of the multimodal network in preserving the inter-and intra-modal consistencies. Based on this guarantee, a novel multimodal deep binary reconstruction model is proposed, which can be trained to simultaneously model the correlation across modalities and learn the binary hashing codes. To generate binary codes and to avoid the tiny gradient problem, a novel activation function first scales the input activations to suitable scopes and, then, feeds them to the tanh function to build the hashing layer. Such a composite function is named adaptive tanh. Both linear and nonlinear scaling methods are proposed and shown to generate efficient codes after training the network. Extensive ablation studies and comparison experiments are conducted for the image2text and text2image retrieval tasks; the method is found to outperform several state-of-the-art deep-learning methods with respect to different evaluation metrics.

关键词Cross-modal hashing binary reconstruction
DOI10.1109/TMM.2018.2866771
收录类别SCI
语种英语
WOS记录号WOS:000462413700013
出版者IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计
被引频次:81[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.opt.ac.cn/handle/181661/31355
专题光谱成像技术研究室
通讯作者Hu, Di
作者单位1.Northwestern Polytech Univ, Sch Comp Sci & Engn, Xian 710072, Shaanxi, Peoples R China
2.Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Shaanxi, Peoples R China
3.Northwestern Polytech Univ, Ctr OPT IMagery Anal & Learning OPTIMAL, Xian 710072, Shaanxi, Peoples R China
4.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
推荐引用方式
GB/T 7714
Hu, Di,Nie, Feiping,Li, Xuelong. Deep Binary Reconstruction for Cross-Modal Hashing[J]. IEEE TRANSACTIONS ON MULTIMEDIA,2019,21(4):973-985.
APA Hu, Di,Nie, Feiping,&Li, Xuelong.(2019).Deep Binary Reconstruction for Cross-Modal Hashing.IEEE TRANSACTIONS ON MULTIMEDIA,21(4),973-985.
MLA Hu, Di,et al."Deep Binary Reconstruction for Cross-Modal Hashing".IEEE TRANSACTIONS ON MULTIMEDIA 21.4(2019):973-985.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Deep Binary Reconstr(1371KB)期刊论文出版稿限制开放CC BY-NC-SA请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Hu, Di]的文章
[Nie, Feiping]的文章
[Li, Xuelong]的文章
百度学术
百度学术中相似的文章
[Hu, Di]的文章
[Nie, Feiping]的文章
[Li, Xuelong]的文章
必应学术
必应学术中相似的文章
[Hu, Di]的文章
[Nie, Feiping]的文章
[Li, Xuelong]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。