A Novel Measure Method for Diversity of Classifier Integrations Using Complement Information Entropy

doi:10.7652/xjtuxb201602003

您当前的位置：

首页 >

文章列表页 >

A Novel Measure Method for Diversity of Classifier Integrations Using Complement Information Entropy

更新时间：2025-07-09

- A Novel Measure Method for Diversity of Classifier Integrations Using Complement Information Entropy
- Vol. 50, Issue 2, Pages: 13-19(2016)
- 作者机构：
  
  1. 第二炮兵工程大学202教研室,西安,710025
  2. 西安交通大学电子与信息工程学院,西安,710049
- 作者简介：
- 基金信息：
- DOI：10.7652/xjtuxb201602003
  CLC： TP391.4
- Online First：10 February 2016，
  
  Published：2016
- 稿件说明：
移动端阅览
A Novel Measure Method for Diversity of Classifier Integrations Using Complement Information Entropy[J]. 2016, 50(2): 13-19.
DOI：

A Novel Measure Method for Diversity of Classifier Integrations Using Complement Information Entropy[J]. 2016, 50(2): 13-19. DOI： 10.7652/xjtuxb201602003.

摘要

针对多分类器系统差异性评价中无法直接处理模糊数据的问题

提出了一种采用互补信息熵的分类器集成差异性度量(CIE)方法。首先利用训练数据生成一系列基分类器

并对测试数据进行分类

将分类结果依次组合生成分类数据空间; 然后采用模糊关系条件下的互补信息熵度量分类数据空间蕴含的不确定信息量

据此信息量判断基分类器间的差异性; 最后以加入基分类器后数据空间差异性增加为选择分类器的基本准则

构建集成分类器系统

用于验证CIE差异性度量与集成分类精度之间的关系。实验结果表明

与Q统计方法相比

利用CIE方法进行分类器集成

平均集成分类精度提高了2.03%

分类器系统集成规模降低约17%

而且提高了集成系统处理多样化数据的能力。

Abstract

A novel diversity measure method using complement information entropy(CIE)is proposed to solve the problem that the diversity estimation of multiple classifier systems is unable to deal directly with fuzzy data. A set of base classifiers is generated by using training data

and then is used to label test data. The outputs of the classifiers are reorganized into a new classification data space. Then the complement information entropy model is introduced under fuzzy relation to measure uncertainty information of the new space and the uncertainty information is used to estimate the diversity of base classifiers. Finally

an ensemble system is constructed based on the criterion that the ensemble diversity of the classifier set increases when a base classifier is added

and the ensemble system is used to validate the performance of CIE. Experimental results and a comparison with the Q-statistic method show that the average classification accuracy of CIE increases by 2.03%

and the number of ensemble classifiers reduces by 17%. Moreover

CIE also improves the ability of ensemble systems to process diverse data.

关键词

Keywords

references

KUNCHEVA L I, SKURICHINA M, DUIN R P W. An experimental study on diversity for bagging and boosting with linear classifiers [J]. Information Fusion, 2002, 3(4): 245-258.

BROWN G, KUNCHEVA L I. “Good” and “bad” diversity in majority vote ensembles [C]∥Proceedings of International Conference on Multiple Classifier Systems. Berlin, Germany: Springer, 2010: 124-133.

张宏达, 王晓丹, 韩钧, 等. 分类器集成差异性研究 [J]. 系统工程与电子技术, 2009, 31(12): 307-3012.

ZHANG Hongda, WANG Xiaodan, HAN Jun, et al. Survey of diversity researches on classifier ensembles [J]. Systems Engineering and Electronics, 2009, 31(12): 3007-3012.

NASCIMENTO D, COELHO A, CANUTO A. Integrating complementary techniques for promoting diversity in classifier ensembles: a systematic study [J]. Neurocomputing, 2014, 138: 347-357.

KUNCHEVA L I, WHITAKER C J. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy [J]. Machine Learning, 2003, 51: 181-207.

WINDEATT T. Diversity measures for multiple classifier system analysis and design [J]. Information Fusion, 2005, 6(1): 21-36.

HAGHIGHI M S, VAHEDIAN A, YAZDI H S. Creating and measuring diversity in multiple classifier systems using support vector data description [J]. Applied Soft Computing, 2011, 11(8): 4931-4942.

KRAWCZYK B, WOZNIAK M. Diversity measures for one-class classifier ensembles [J]. Neurocomputing, 2004, 126: 36-44.

YIN X C, HUANG K Z, HAO H W, et al. A novel classifier ensemble method with sparsity and diversity [J]. Neurocomputing, 2014, 134: 214-221.

BI Y X. The impact of diversity on the accuracy of evidential classifier ensembles [J]. International Journal of Approximate Reasoning, 2012, 53(4): 584-607.

AKSELA M, LAAKSONEN J. Using diversity of errors for selecting members of a committee classifier [J]. Pattern Recognition, 2006, 39(4): 608-623.

RASHEED S, STASHUK D W, KAMEL M S. Diversity-based combination of non-parametric classifiers for EMG signal decomposition [J]. Pattern Anal Applic, 2008, 11(3/4): 385-408.

杨春, 殷绪成, 郝红卫, 等. 基于差异性的分类器集成有效性分析及优化集成 [J]. 自动化学报, 2014, 40(4): 660-674.

YANG Chun, YIN Xucheng, HAO Hongwei, et al. Classifier ensemble with diversity: effectiveness analysis and ensemble optimization [J]. Acta Automatica Sinica, 2014, 40(4): 660-674.

杨长盛, 陶亮, 曹振田, 等. 基于成对差异性度量的选择性集成方法 [J]. 模式识别与人工智能, 2010, 23(4): 565-571.

YANG Changsheng, TAO Liang, CAO Zhentian, et al. Pairwise diversity measures based selective ensemble method [J]. PRAI, 2010, 23(4): 565-571.

谷雨. 分类器集成中的多样性度量 [J]. 云南民族大学学报: 自然科学版, 2012, 21(1): 59-65.

GU Yu. Measure diversity classifier ensemble [J]. Journal of Yunnan National University: Natural Science, 2012, 21(1): 59-65.

LIU W Y, WU Z H, PAN G. An entropy-based diversity measure for classifier combining and its application to face classifier ensemble thinning [C]∥Proceedings of International Conference on Sinobiometrics. Berlin, Germany: Springer, 2004: 118-124.

LIANG J, CHIN K, DANG C. A new method for measuring uncertainty and fuzziness in rough set theory [J]. International Journal of General Systems, 2002, 31(4): 331-342.

YU D, HU Q, WU C. Uncertainty measures for fuzzy relations and their applications [J]. Applied Soft Computing, 2007, 7(3): 1135-1143.

ZHAO J, ZHANG Z, HAN C, et al. Complement information entropy for uncertainty measure in fuzzy rough set and its application [J]. Soft Computing, 2015, 19(7): 1997-2010.

BLAKE C L. MERZ C L. UCI repository of machine learning databases [EB/OL].(2007-10-12)[2015-05-08]. http:∥www.ics.uci.edu/～mlearn/MLRepository.html.

兰景宏,刘胜利,吴双,等.用于木马流量检测的集成分类模型.2015,49(8):84-89.[doi:10.7652/xjtuxb201508014]

喻明让,张英杰,陈琨,等.考虑调整时间的作业车间调度与预防性维修集成方法.2015,49(6):16-21.[doi:10.7652/xjtuxb201506003]

杨宏晖,王芸,孙进才,等.融合样本选择与特征选择的AdaBoost支持向量机集成算法.2014,48(12):63-68.[doi:10.7652/xjtuxb201412010]

王羡慧,覃征,张选平,等.采用仿射传播的聚类集成算法.2011,45(8):1-6.[doi:10.7652/xjtuxb201108001]

马超,陈西宏,徐宇亮,等.广义邻域粗集下的集成特征选择及其选择性集成算法.2011,45(6):34-39.[doi:10.7652/xjtuxb201106006]

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Diffusion Characteristics and Influencing Factors in Case of Hydrogen Leakage from Fuel Cell Vehicles Running in Tunnels

A Structure-Semantics-Residual Collaborative Image Compression Framework：Towards Privacy Protection and High-Fidelity Reconstruction

Sensitivity Analysis of Foil Geometrical Parameters for the Third-Generation CO2 Gas Foil Bearings Based on Design of Experiments Method

Electrothermal Coupling Research on the Evolutionary Law of Anti-Corona Performance for High-Altitude Air-Cooled Generators

Knowledge Graph Representation Learning Driven by Semantic Discrimination and Subgraph Integration

Related Author

No data

Related Institution

No data

⁰