OPT OpenIR  > 光谱成像技术实验室
Image sentiment prediction based on textual descriptions with adjective noun pairs
Li, Zuhe1,2; Fan, Yangyu1; Liu, Weihua3; Wang, Fengqin2
Contribution Rank3

We aim to predict the sentiment related information reflected in images based on SentiBank, which is a library including Adjective Noun Pair (ANP) concept detectors for image sentiment analysis. Instead of using only ANP responses in images as mid-level features, we make full use of the ANPs' textual sentiment. We first give each ANP concept in SentiBank a sentiment value by adding together the textual sentiment value of the adjective and that of the noun. Having detected the presence of ANPs in an image, we define an image sentiment value by computing the weighted sum of the textual sentiment values of ANPs describing this image with corresponding ANP responses as weights. On the one hand, we adopt a one-dimension logistic regression model to predict the sentiment orientation according to the image sentiment value. On the other hand, we use the ANP responses detected in an image as mid-level representations to train a regularized logistic regression classifier for sentiment prediction. We finally employ a late fusion algorithm to combine the prediction results from the two schemes. Experimental results reveal that the proposed method which takes into account the textual sentiment of ANPs improves the performance of SentiBank based image sentiment prediction.

KeywordImage Sentiment Textual Sentiment Concept Detection Late Fusion
Indexed BySCI ; EI
WOS IDWOS:000419995400047
EI Accession Number20170203237429
Citation statistics
Cited Times:2[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Affiliation1.Northwestern Polytech Univ, Sch Elect & Informat, Xian 710072, Shaanxi, Peoples R China;
2.Zhengzhou Univ Light Ind, Sch Comp & Commun Engn, Zhengzhou 450002, Henan, Peoples R China;
3.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Shaanxi, Peoples R China
Recommended Citation
GB/T 7714
Li, Zuhe,Fan, Yangyu,Liu, Weihua,et al. Image sentiment prediction based on textual descriptions with adjective noun pairs[J]. MULTIMEDIA TOOLS AND APPLICATIONS,2018,77(1):1115-1132.
APA Li, Zuhe,Fan, Yangyu,Liu, Weihua,&Wang, Fengqin.(2018).Image sentiment prediction based on textual descriptions with adjective noun pairs.MULTIMEDIA TOOLS AND APPLICATIONS,77(1),1115-1132.
MLA Li, Zuhe,et al."Image sentiment prediction based on textual descriptions with adjective noun pairs".MULTIMEDIA TOOLS AND APPLICATIONS 77.1(2018):1115-1132.
Files in This Item:
File Name/Size DocType Version Access License
Image sentiment pred(2143KB)期刊论文出版稿暂不开放CC BY-NC-SAApplication Full Text
Related Services
Recommend this item
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Li, Zuhe]'s Articles
[Fan, Yangyu]'s Articles
[Liu, Weihua]'s Articles
Baidu academic
Similar articles in Baidu academic
[Li, Zuhe]'s Articles
[Fan, Yangyu]'s Articles
[Liu, Weihua]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Li, Zuhe]'s Articles
[Fan, Yangyu]'s Articles
[Liu, Weihua]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.