OPT OpenIR  > 光学定向与测量技术研究室
Text recognition from silent lip movement video
Wei, Youda1,2; Hu, Xiaodong1
2019-01-02
Conference Name2018 IEEE 3rd International Conference on Signal and Image Processing, ICSIP 2018
Source Publication2018 IEEE 3rd International Conference on Signal and Image Processing, ICSIP 2018
Pages168-171
Conference Date2018-07-13
Conference PlaceShenzhen, China
PublisherInstitute of Electrical and Electronics Engineers Inc.
Contribution Rank1
AbstractLip reading, the ability to recognize text information from the movement of a speaker's mouth, is a difficult and challenging task. Recently, the end-to-end model that maps a variable-length sequence of video frames to text performs poorly in real life situation where people unintentionally move the lips instead of speaking. The goal of this work is to improve the performance of lip reading task in real life. The model proposed in this article consists of two networks that are visual to audio feature network and audio feature to text network. Our experiments showed that the model proposed in this article can achieve 92.76% accuracy in lip reading task on the dataset that the unintentional lips movement was added. ? 2018 IEEE.
Department光学定向与测量技术研究室
DOI10.1109/SIPROCESS.2018.8600535
Indexed ByEI
ISBN9781538663943
Language英语
EI Accession Number20190806535377
Citation statistics
Document Type会议论文
Identifierhttp://ir.opt.ac.cn/handle/181661/31280
Collection光学定向与测量技术研究室
Affiliation1.Xi'an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi'an, China;
2.University of Chinese Academy of Sciences, Beijing, China
Recommended Citation
GB/T 7714
Wei, Youda,Hu, Xiaodong. Text recognition from silent lip movement video[C]:Institute of Electrical and Electronics Engineers Inc.,2019:168-171.
Files in This Item:
File Name/Size DocType Version Access License
Text recognition fro(2638KB)会议论文 开放获取CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wei, Youda]'s Articles
[Hu, Xiaodong]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wei, Youda]'s Articles
[Hu, Xiaodong]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wei, Youda]'s Articles
[Hu, Xiaodong]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.