To alleviate the independent assumption on the attribute of the naive Bayes classification
an association rule forest representation and a modified Bayes classifier called ABC are proposed. A data mining method is used to get useful association rules. An association rule forest is constructed from all the resulting useful association rules. Then the joint probability of all the attributes contained in an instance is calculated by multiplying the probabilities of all root nodes with the confidences of all the useful association rules. UDI dataset is used to verify the validation of the ABC. Experimental results show that the ABC has higher classification accuracy
with 5% average improvement
than the naive Bayes one has. Especially
for the dataset containing strong associated attributes
37% improvement in accuracy is obtained.
关键词
Keywords
references
HAN Jiawei, KAMBER M. 数据挖掘概念与技术[M].范明,孟小峰,译. 北京: 机械工业出版社, 2006.
FRIEDMAN N, GEIGER D, GOLDSZMIT M. Bayesian network classifier[J]. Machine Learning, 1997, 29: 131-163.
KEOGH E J, PAZZANNI M J. Learning augmented Bayesian classifiers: a comparison of distribution-based and classification-based approaches[C]∥Proceedings of the 7th International Workshop on Artificial Intelligence and Statistics. San Francisco: Morgan Kaufmann Publishers, 1999: 225-230.
CHICKERING D M, GEIGER D, HECKERMAN D. Learning Bayesian networks is NP-complete[M]∥Learning from Data: Artificial Intelligence and Statistics. Berlin, Germany: Springer-Verlag, 1996: 121-130.
WEBB G I, BOUGHTON J R, WANG Zhihai. Not so naive Bayes: aggregating one-dependence estimators [J]. Machine Learning, 2005, 58(1): 5-24.
MARTINEZ M, SUCAR L E. Learning an optimal naive Bayes classifier [C]∥Proceedings of International Conference on Pattern Recognition. Las Alamitos, CA, USA: IEEE Computer Society Press, 2006: 1236-1239.
SHI Hongbo, WANG Zhihai, HUANG Houkuan, et al. A restricted double-level Bayesian classification model [J]. Journal of Software, 2004, 15(2): 193-199.
MERETAKIS D, WUTHRICH B. Extending naive Bayes classification using long itemsets [C]∥Proceedings of 5th ACM SIGKDD International Conf on Knowledge Discovery and Data Mining.New York, USA: ACM Press,1999:165-174.
ABELLÁN J, CANO A, MASEGOSA A R, et al. A semi-naive Bayes classifier with grouping of cases [C]∥Proceedings of European Conference on Symbolic and Quantitative Approaches to Reasoning with Uncertainty. Berlin, Germany: Springer-Verlay, 2007: 477-488.
XU Junming, JIANG Yuan, ZHOU Zhihua. Bayesian classifier based on frequent item sets mining [J]. Journal of Computer Research and Development, 2007, 44(8):1293-1300.
HAN Jiawei, PEI Jian, YIN Yiwen, et al. Mining frequent patterns without candidate generation: a frequent-pattern tree approach[J]. Data Mining and Knowledge Discovery, 2004, 8(1): 53-87.