OPT OpenIR  > 光谱成像技术研究室
Local and correlation attention learning for subtle facial expression recognition
Wang, Shaocong1,2; Yuan, Yuan3; Zheng, Xiangtao1; Lu, Xiaoqiang1
作者部门光谱成像技术研究室
2021-09-17
发表期刊Neurocomputing
ISSN09252312;18728286
卷号453页码:742-753
产权排序1
摘要

Subtle facial expression recognition (SFER) aims to classify facial expressions with very low intensity into corresponding human emotions. Subtle facial expression can be regarded as a special kind of facial expression, whose facial muscle movements are more difficult to capture. In the last decade, various methods have been developed for common facial expression recognition (FER). However, most of them failed to automatically find the most discriminative parts of facial expression and the correlation of muscle movements when human makes facial expression, which makes them unsuitable for SFER. To better solve SFER problem, an attention mechanism based model focusing on salient local regions and their correlations is proposed in this paper. The proposed method: 1) utilizes multiple attention blocks to attend to distinct discriminative regions and extract corresponding local features automatically, 2) a correlation attention module is integrated in the model to extract global correlation feature over the salient regions, and finally 3) fuses the correlation feature and local features in an efficient way for the final facial expression classification. By this way, the useful but subtle local information can be utilized in more detail, and the correlation of different local regions is also extracted. Extensive experiment on the LSEMSW and CK+ datasets shows that the method proposed in this paper achieves superior results, which demonstrates its effectiveness. © 2020 Elsevier B.V.

关键词Facial expression recognition Feature extraction Neural network Attention mechanism
DOI10.1016/j.neucom.2020.07.120
收录类别SCI ; EI
语种英语
WOS记录号WOS:000663417700007
出版者Elsevier B.V., Netherlands
EI入藏号20203909248807
引用统计
被引频次:7[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.opt.ac.cn/handle/181661/93716
专题光谱成像技术研究室
通讯作者Zheng, Xiangtao
作者单位1.Key Laboratory of Spectral Imaging Technology CAS, Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an; Shaanxi; 710119, China;
2.University of Chinese Academy of Sciences, Beijing; 100049, China;
3.Center for OPTical IMagery Analysis and Learning(OPTIMAL), Northwestern Polytechnical University, Xi'an; 710072, China
推荐引用方式
GB/T 7714
Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,et al. Local and correlation attention learning for subtle facial expression recognition[J]. Neurocomputing,2021,453:742-753.
APA Wang, Shaocong,Yuan, Yuan,Zheng, Xiangtao,&Lu, Xiaoqiang.(2021).Local and correlation attention learning for subtle facial expression recognition.Neurocomputing,453,742-753.
MLA Wang, Shaocong,et al."Local and correlation attention learning for subtle facial expression recognition".Neurocomputing 453(2021):742-753.
条目包含的文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
Local and correlatio(2425KB)期刊论文出版稿限制开放CC BY-NC-SA请求全文
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Wang, Shaocong]的文章
[Yuan, Yuan]的文章
[Zheng, Xiangtao]的文章
百度学术
百度学术中相似的文章
[Wang, Shaocong]的文章
[Yuan, Yuan]的文章
[Zheng, Xiangtao]的文章
必应学术
必应学术中相似的文章
[Wang, Shaocong]的文章
[Yuan, Yuan]的文章
[Zheng, Xiangtao]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。