An unsupervised topic and sentiment unification model
UTSU model for short
is proposed based on the LDA-Col model. Unlike the ASUM model and the JST model that sample sentiments and topics from the same plate
the UTSU model imposes the constraint that all words in a sentence are generated from one sentiment and each word in the sentence is generated from one topic. The constraint accords with the sentiment expression of language and will not limit the topic relation of words. The experiments of sentiment classification show that the result of the UTSU model is close to the results of supervised classification methods and outperforms other topic and sentiment unification models. Comparisons with the ASUM and JST models show that the UTSU model improves the F1 value of sentiment classification by about 3% and 17%
respectively.
关键词
Keywords
references
LANDAUER T K, FOLTZ P W, LAHAM D. An introduction to latent semantic analysis [J]. Discourse Processes, 1998, 25(2/3): 259-284.
HOFMANN T. Unsupervised learning by probabilistic latent semantic analysis [J]. Machine Learning, 2001, 42(1/2): 177-196.
BLEI D M, NG A Y, JORDAN M I. Latent Dirichlet allocation [J]. Journal of Machine Learning Research, 2003, 3(4/5): 993-1022.
GRIFFITHS T L, STEYVERS M, TENEN-BAUM J B. Topic in semantic representation [J]. Psychological Review, 2007, 114(2): 211-244.
TITOV I, MCDONALD R. A joint model of text and aspect ratings for sentiment summarization [C]∥Proceedings of 2008 Association for Computational Linguistics with the Human Language Technology Conference. Stroudsburg, PA, USA: Association for Computational Linguistics, 2008: 308-316.
ZHAO Xin, JIANG Jing, YAN Hongfei, et al. Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid [C]∥Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics, 2010: 56-65.
BRODY S, ELHADAD N. An unsupervised aspect-sentiment model for online reviews [C]∥Proceedings of the 2010 Annual Conference of the North American Chapter of the ACL. Stroudsburg, PA, USA: Association for Computational Linguistics, 2010: 804-812.
MEI Qiaozhu, LING Xu, WONDRA M, et al. Topic sentiment mixture: modeling facets and opinions in weblogs [C]∥Proceeding of the 16th International Conference on World Wide Web. New York, USA: ACM, 2007: 171-180.
JO Y, OH A. Aspect and sentiment unification model for online review analysis [C]∥Proceedings of the 4th ACM International Conference on Web Search and Data Mining. New York, USA: ACM, 2011: 815-824.
LIN Chenghua, HE Yulan. Joint sentiment/topic model for sentiment analysis [C]∥Proceedings of the 18th ACM Conference on Information and Knowledge Management. New York, USA: ACM, 2009: 375-384.
PANG Bo, LEE L, VAITHYANATHAN S. Thumbs up?: sentiment classification using machine learning techniques [C]∥Proceedings of the Conference on Empirical Methods in Natural Language Processing. Stroudsburg, PA, USA: Association for Computational Linguistics, 2002: 79-86.