An Unbalanced Emotion Classification Method for Interactive Texts Based on Multiple-Domain Instance Transfer[J]. 2015, 49(4): 67-72.
DOI:
An Unbalanced Emotion Classification Method for Interactive Texts Based on Multiple-Domain Instance Transfer[J]. 2015, 49(4): 67-72.DOI: 10.7652/xjtuxb201504011.
An Unbalanced Emotion Classification Method for Interactive Texts Based on Multiple-Domain Instance Transfer
A data level sampling method of target dataset-oriented instance transfer is proposed to solve the problem that the characteristics of interactive texts such as short sentences
missing parts of sentences and unbalanced class distribution in multiple-domains result in difficulties of high dimension
sparse eigenvalue in feature space and lack of positive instances. A function is employed to choose features for evaluating the instance similarity between source and target datasets. The function calculates the sum of the information gains of Top-N common features of these two datasets and their proportions in the sum. Moreover
a homogenization processing method is presented for feature spaces of the target dataset and the source dataset to overcome the feature spaces inconsistency between these two datasets. A method for selecting and transferring instances from a domain of source dataset to the corresponding one of target dataset is adopted to solve the problem of unbalanced class distribution in multiple domains. Experimental results show that the proposed method effectively alleviates the unbalanced problem in target dataset. The proposed method running with four classic classification methods
i.e. support vector machine
random forest
naive Bayes
and random committee
results in an 11.3% improvement in average of weighted receiver operating characteristic curve(ROC).
关键词
Keywords
references
OGURA H, AMANO H, KONDO M. Comparison of metrics for feature selection in imbalanced text classification [J]. Expert Systems with Applications, 2011, 38(5): 4978-4989.
DAI Wenyuan, YANG Qiang, XUE Guirong, et al. Boosting for transfer learning [C]∥Proceedings of the 24th International Conference on Machine Learning. New York, USA: ACM, 2007: 193-200.
TIAN Feng, GAO Pengda, LI Longzhuang, et al. Recognizing and regulating e-learners' emotions based on interactive Chinese texts in e-learning systems [J]. Knowledge-Based Systems, 2014, 55: 148-164.
TIAN Feng, LIANG Huijun, LI Longzhuang, et al. Sentiment classification in turn-level interactive Chinese texts of e-learning applications [C]∥Proceedings of the 2012 IEEE 12th International Conference on Advanced Learning Technologies. Piscataway, NJ, USA: IEEE, 2012: 480-484.
BARANDELA R, VALDOVINOS R M, SÁNCHEZ J S, et al. The imbalanced training sample problem: under or over sampling? [C]∥Proceedings of the IAPR International Workshops on Structural, Syntactic, and Statistical Pattern Recognition. Berlin, Germany: Springer, 2004: 806-814.
CHAWLA N V. C4.5 and imbalanced data sets: investigating the effect of sampling method, probabilistic estimate, and decision tree structure [C]∥Proceedings of the International Conference on Machine Learning from Imbalanced Datasets: Ⅱ. New York, USA: ACM, 2003: 1-8.
SUN Yanmin, KAMEL M S, WONG A K C, et al. Cost-sensitive boosting for classification of imbalanced data [J]. Pattern Recognition, 2007, 40(12): 3358-3378.
ZHOU Zhihua, LIU Xuying. Training cost-sensitive neural networks with methods addressing the class imbalance problem [J]. IEEE Transactions on Knowledge and Data Engineering, 2006, 18(1): 63-77.
WANG Suge, LI Deyu, ZHAO Lidong, et al. Sample cutting method for imbalanced text sentiment classification based on BRC [J]. Knowledge-Based Systems, 2013, 37: 451-461.
LIU Ying, LOH H T, SUN Aixin. Imbalanced text classification: a term weighting approach [J]. Expert Systems with Applications, 2009, 36(1): 690-701.
HAN Jiawei, KAMBER M. 数据挖掘概念与技术 [M]. 2版. 范明, 孟小峰,译. 北京: 机械工业出版社, 2006: 216-217.