To avoid information loss and cut points decrease after discretization of continuous attributes
a synchronized continuous attribute discretization algorithm with good global clustering effect for selecting cut points from all conditions attributes is presented. This algorithm decides which continuous attribute should be inserted according to the cut point from all attributes based on the influence of the inserted cut point. The influence is evaluated by information system approximation classification quality. Then cut point is selected from the candidate points in the attribute according to Ameva statistics
and the level of indiscernibility relation is chosen as the stopping condition of the algorithm. By UCI machine learning data sets a comparison with several classic discretization algorithms shows that the C45 classification model based on the proposed algorithm is of good classification accuracy and needs less nodes.
关键词
Keywords
references
XU E, SHAO Liangshan.A new discretization approach of continuous attributes [C]∥Proceedings of the 2010 Asia-Pacific Conference on Wearable Computing Systems:APWC 2010.Piscataway,NJ,USA:IEEE Computer Society,2010:136-138.
MIZIANTY M J,KURGAN L A,OGILA M R.Discretization as the enabling technique for the Naive Bayes and semi-Naive Bayes-based classification [J].Knowledge Engineering Review,2010,25(4):421-449.
KERBER R.ChiMerge:discretization of numeric attributes [C]∥Proceedings of Ninth National Conference on Artificial Intelligence. Menlo Park, CA,USA:AAAI Press,1992:123-128.
LIU Huan,SETIONO R.Feature selection via discretization [J].IEEE Transactions on Knowledge and Data Engineering,1997,9(4):642-645.
TAY E H, SHEN L.A modified chi2 algorithm for discretization [J].IEEE Transactions on Knowledge and Data Engineering,2002,14(3):666-670.
CBAO T S, JYH H H.An extended chi2 algorithm for discretization of real value attributes [J].IEEE Transactions on Knowledge and Data Engineering,2005,17(3):437-441.
MARCE B.Khiops:a statistical discretization method of continuous attributes [J].Machine Learning,2004,55(1):53-69.
GONZALEZ A L,CUBEROS F J,VELASCO F.Ameva:an autonomous discretization algorithm [J].Expert Systems with Applications,2008,36(3):5327-5332.
WANG Guoyin.Cut's discriminability based continuous attributes discretization in rough set [J].Journal of Chongqing University of Posts and Telecommunications,2010,22(2):257-261.
MERZ C J,MURPHY P M.UCI repository of machine learning database [EB/OL].[2003-08-16].http:∥www.ics.uci.edu/~mlearn/MLRepository.html.
MITCHELL T M. Machine learning [M].Beijing, China: China Machine Press,2003:52-180.
FAYYAD U,IRANI K.Multi-interval discretization of continuous-valued attributes for classification learning [C]∥Thirteenth International Conference on Machine Learning.Bari,Italy:Morgan Kaufmann,1996:157-165.
CERQUIDES J,MANTARAS R L.Proposal and empirical comparison of a parallelizable distance based discretization method [C]∥Third International Conference on Knowledge Discovery and Data Mining:KDD97. Newport Beach, CA,USA:AAAI Press,1997:139-142.
HO K M,SCOTT P D.Zeta:a global method for discretization for continuous variables[C]∥Third International Conference on Knowledge Discovery and Data Mining:KDD97. Newport Beach, CA,USA:AAAI Press,1997:191-194.