Key Frame Extraction in the Summary Space | |
Li, Xuelong1; Zhao, Bin2; Lu, Xiaoqiang1; Lu, XQ (reprint author), Chinese Acad Sci, Ctr Opt Imagery Anal & Learning, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China. | |
作者部门 | 光学影像学习与分析中心 |
2018-06 | |
发表期刊 | IEEE TRANSACTIONS ON CYBERNETICS |
ISSN | 2168-2267 |
卷号 | 48期号:6页码:1923-1934 |
产权排序 | 1 |
摘要 | Key frame extraction is an efficient way to create the video summary which helps users obtain a quick comprehension of the video content. Generally, the key frames should be representative of the video content, meanwhile, diverse to reduce the redundancy. Based on the assumption that the video data are near a subspace of a high-dimensional space, a new approach, named as key frame extraction in the summary space, is proposed for key frame extraction in this paper. The proposed approach aims to find the representative frames of the video and filter out similar frames from the representative frame set. First of all, the video data are mapped to a high-dimensional space, named as summary space. Then, a new representation is learned for each frame by analyzing the intrinsic structure of the summary space. Specifically, the learned representation can reflect the representativeness of the frame, and is utilized to select representative frames. Next, the perceptual hash algorithm is employed to measure the similarity of representative frames. As a result, the key frame set is obtained after filtering out similar frames from the representative frame set. Finally, the video summary is constructed by assigning the key frames in temporal order. Additionally, the ground truth, created by filtering out similar frames from human-created summaries, is utilized to evaluate the quality of the video summary. Compared with several traditional approaches, the experimental results on 80 videos from two datasets indicate the superior performance of our approach. |
关键词 | Diverse Key Frame Representative Summary Space |
学科领域 | Automation & Control Systems |
DOI | 10.1109/TCYB.2017.2718579 |
收录类别 | SCI ; EI |
语种 | 英语 |
WOS研究方向 | Automation & Control Systems ; Computer Science |
WOS记录号 | WOS:000435342400020 |
EI入藏号 | 20172903947231 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.opt.ac.cn/handle/181661/30402 |
专题 | 光谱成像技术研究室 |
通讯作者 | Lu, XQ (reprint author), Chinese Acad Sci, Ctr Opt Imagery Anal & Learning, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China. |
作者单位 | 1.Chinese Acad Sci, Ctr Opt Imagery Anal & Learning, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China 2.Northwestern Polytech Univ, Ctr Opt Imagery Anal & Learning, Xian 710072, Shaanxi, Peoples R China |
推荐引用方式 GB/T 7714 | Li, Xuelong,Zhao, Bin,Lu, Xiaoqiang,et al. Key Frame Extraction in the Summary Space[J]. IEEE TRANSACTIONS ON CYBERNETICS,2018,48(6):1923-1934. |
APA | Li, Xuelong,Zhao, Bin,Lu, Xiaoqiang,&Lu, XQ .(2018).Key Frame Extraction in the Summary Space.IEEE TRANSACTIONS ON CYBERNETICS,48(6),1923-1934. |
MLA | Li, Xuelong,et al."Key Frame Extraction in the Summary Space".IEEE TRANSACTIONS ON CYBERNETICS 48.6(2018):1923-1934. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Key Frame Extraction(2123KB) | 期刊论文 | 作者接受稿 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论