OPT OpenIR  > 光谱成像技术研究室
A deep hashing technique for remote sensing image-sound retrieval
Chen, Yaxiong1,2; Lu, Xiaoqiang1
作者部门光谱成像技术研究室
2020
发表期刊Remote Sensing
ISSN20724292
卷号12期号:1
产权排序1
摘要

With the rapid progress of remote sensing (RS) observation technologies, cross-modal RS image-sound retrieval has attracted some attention in recent years. However, these methods perform cross-modal image-sound retrieval by leveraging high-dimensional real-valued features, which can require more storage than low-dimensional binary features (i.e., hash codes). Moreover, these methods cannot directly encode relative semantic similarity relationships. To tackle these issues, we propose a new, deep, cross-modal RS image-sound hashing approach, called deep triplet-based hashing (DTBH), to integrate hash code learning and relative semantic similarity relationship learning into an end-to-end network. Specially, the proposed DTBH method designs a triplet selection strategy to select effective triplets. Moreover, in order to encode relative semantic similarity relationships, we propose the objective function, which makes sure that that the anchor images are more similar to the positive sounds than the negative sounds. In addition, a triplet regularized loss term leverages approximate l1-norm of hash-like codes and hash codes and can effectively reduce the information loss between hash-like codes and hash codes. Extensive experimental results showed that the DTBH method could achieve a superior performance to other state-of-the-art cross-modal image-sound retrieval methods. For a sound query RS image task, the proposed approach achieved a mean average precision (mAP) of up to 60.13% on the UCM dataset, 87.49% on the Sydney dataset, and 22.72% on the RSICD dataset. For RS image query sound task, the proposed approach achieved a mAP of 64.27% on the UCM dataset, 92.45% on the Sydney dataset, and 23.46% on the RSICD dataset. Future work will focus on how to consider the balance property of hash codes to improve image-sound retrieval performance. © 2019 by the authors.

关键词cross-modal retrieval deep hash codes semantic similarity relationships remote sensing
DOI10.3390/RS12010084
收录类别SCI ; EI
语种英语
WOS记录号WOS:000515391700084
出版者MDPI AG, Postfach, Basel, CH-4005, Switzerland
EI入藏号20200808209252
引用统计
被引频次:29[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.opt.ac.cn/handle/181661/93285
专题光谱成像技术研究室
通讯作者Lu, Xiaoqiang
作者单位1.Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an; 710119, China;
2.University of Chinese Academy of Sciences, Beijing; 100049, China
推荐引用方式
GB/T 7714
Chen, Yaxiong,Lu, Xiaoqiang. A deep hashing technique for remote sensing image-sound retrieval[J]. Remote Sensing,2020,12(1).
APA Chen, Yaxiong,&Lu, Xiaoqiang.(2020).A deep hashing technique for remote sensing image-sound retrieval.Remote Sensing,12(1).
MLA Chen, Yaxiong,et al."A deep hashing technique for remote sensing image-sound retrieval".Remote Sensing 12.1(2020).
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
A deep hashing techn(4010KB)期刊论文出版稿限制开放CC BY-NC-SA请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Chen, Yaxiong]的文章
[Lu, Xiaoqiang]的文章
百度学术
百度学术中相似的文章
[Chen, Yaxiong]的文章
[Lu, Xiaoqiang]的文章
必应学术
必应学术中相似的文章
[Chen, Yaxiong]的文章
[Lu, Xiaoqiang]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。