OPT OpenIR  > 光学影像学习与分析中心
Perceptually Aware Image Retargeting for Mobile Devices
Zhou, Yinzuo1; Zhang, Luming2; Zhang, Chao3; Li, Ping4,5; Li, Xuelong6
作者部门光学影像学习与分析中心
2018-05-01
发表期刊IEEE TRANSACTIONS ON IMAGE PROCESSING
ISSN1057-7149
卷号27期号:5页码:2301-2313
产权排序6
摘要

Retargeting aims at adapting an original high-resolution photograph/video to a low-resolution screen with an arbitrary aspect ratio. Conventional approaches are generally based on desktop PCs, since the computation might be intolerable for mobile platforms (especially when retargeting videos). Typically, only low-level visual features are exploited, and human visual perception is not well encoded. In this paper, we propose a novel retargeting framework that rapidly shrinks a photograph/video by leveraging human gaze behavior. Specifically, we first derive a geometry-preserving graph ranking algorithm, which efficiently selects a few salient object patches to mimic the human gaze shifting path (GSP) when viewing a scene. Afterward, an aggregation-based CNN is developed to hierarchically learn the deep representation for each GSP. Based on this, a probabilistic model is developed to learn the priors of the training photographs that are marked as aesthetically pleasing by professional photographers. We utilize the learned priors to efficiently shrink the corresponding GSP of a retargeted photograph/video to maximize its similarity to those from the training photographs. Extensive experiments have demonstrated that: 1) our method requires less than 35 ms to retarget a 1024x768 photograph (or a 1280x720 video frame) on popular iOS/Android devices, which is orders of magnitude faster than the conventional retargeting algorithms; 2) the retargeted photographs/videos produced by our method significantly outperform those of its competitors based on a paired-comparison-based user study; and 3) the learned GSPs are highly indicative of human visual attention according to the human eye tracking experiments.

 

关键词Mobile Platform Retarget Perceptual Gaze Behavior Deep Feature Probabilistic Model
DOI10.1109/TIP.2017.2779272
收录类别SCI ; EI
语种英语
WOS记录号WOS:000426272000017
引用统计
被引频次:1[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.opt.ac.cn/handle/181661/30766
专题光学影像学习与分析中心
作者单位1.Hangzhou Normal Univ, Alibaba Res Ctr Complex Sci, Hangzhou 311121, Zhejiang, Peoples R China;
2.Zhejiang Univ, Coll Comp Sci, Hangzhou 310000, Zhejiang, Peoples R China;
3.Univ Illinois, Comp Sci Dept, Champaign, IL 61820 USA;
4.Hangzhou Dianzi Univ, Sch Comp Sci & Technol, Hangzhou 310018, Zhejiang, Peoples R China;
5.Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210093, Jiangsu, Peoples R China;
6.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Ctr OPT IMagery Anal & Learning, State Key Lab Transient Opt & Photon, Xian 710119, Shaanxi, Peoples R China
推荐引用方式
GB/T 7714
Zhou, Yinzuo,Zhang, Luming,Zhang, Chao,et al. Perceptually Aware Image Retargeting for Mobile Devices[J]. IEEE TRANSACTIONS ON IMAGE PROCESSING,2018,27(5):2301-2313.
APA Zhou, Yinzuo,Zhang, Luming,Zhang, Chao,Li, Ping,&Li, Xuelong.(2018).Perceptually Aware Image Retargeting for Mobile Devices.IEEE TRANSACTIONS ON IMAGE PROCESSING,27(5),2301-2313.
MLA Zhou, Yinzuo,et al."Perceptually Aware Image Retargeting for Mobile Devices".IEEE TRANSACTIONS ON IMAGE PROCESSING 27.5(2018):2301-2313.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Perceptually Aware I(3015KB)期刊论文出版稿开放获取CC BY-NC-SA浏览 请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Zhou, Yinzuo]的文章
[Zhang, Luming]的文章
[Zhang, Chao]的文章
百度学术
百度学术中相似的文章
[Zhou, Yinzuo]的文章
[Zhang, Luming]的文章
[Zhang, Chao]的文章
必应学术
必应学术中相似的文章
[Zhou, Yinzuo]的文章
[Zhang, Luming]的文章
[Zhang, Chao]的文章
相关权益政策
暂无数据
收藏/分享
文件名: Perceptually Aware Image Retargeting for Mobile Devices.pdf
格式: Adobe PDF
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。