Since the current information measures of discretization can not accurately reflect the degree of the effective class information in the discretized dataset
a discretization algorithm based on effective information ratio is presented
and a contingency table of corresponding discretization scheme is constructed. According to the analyses of the relationship between the class distribution and the remaining class information
the effective information ratio based on the class distribution is analyzed to indicate the degree of effective information in each discretized interval. An improved discretization criterion is generated to evaluate the quality of the discretization scheme following the number of discrete internal and the effective information ratio. The simulation and applications illustrate the more effective class information and the higher classification accuracy than the other information-based solutions.
CHIU D K Y, WONG A K C, CHEUNG B. Information discovery through hierarchical maximum entropy discretization and synthesis[C]∥Knowledge Discovery in Databases. Cambridge, Massachusetts, USA: MIT Press, 1991:125-140.
QU Wenyu, YAN Deqian, SANG Yu. A novel chi2 algorithm for discretization of continuous attributes[C]∥Progress in WWW Research and Development 10th Asia-Pacific Web Conference. Heidelberg, Germany: Springer-Verlag, 2008:560-571.
BOULLE M. Khiops: a statistical discretization method of continuous attributes[J]. Machine Learning, 2004, 55(1): 53-59.
KUMAR A, ZHANG D. Hand-geometry recognition using entropy-based discretization[J]. IEEE Transactions on Information Forensics and Security, 2007, 2(2): 181-187.
SIMOVICI D A, JAROSZEWICZ S. An axiomatization of partition entropy[J]. IEEE Transactions on Information Theory, 2002, 48(7): 2138-2142.
LE D D, SATOH S. Ent-boost: boosting using entropy measures for robust object detection[J]. Pattern Recognition Letters, 2007, 28(9): 1083-1090.
KURGAN L A, CIOS K J. CAIM discretization algorithm[J]. IEEE Transactions on Knowledge and Data Engineering, 2004, 16(2): 145-153.
TSAI C J, LEE C I, YANG W P. A discretization algorithm based on class-attribute contingency coefficient[J]. Information Sciences, 2008, 178(3): 714-731.
QUINLAN J R. C4.5: programs for machine learning[M]. San Mateo, CA, USA: Morgan Kaufmann Publishers, 1993:17-25.
FRANK A, ASUNCION A. UCI machine learning repository [EB/OL]. [2010-08-22]. http:∥archive.ics.uci.edu/ml.
TIE Ming, YUE Heng, CHAI Tianyou. A hybrid intelligent soft-sensor model for dynamic particle size estimation in grinding circuits [J]. Lecture Notes in Computer Science, 2005, 3498: 871-876.
POLKOWSKI L, TSUMOTO S, LIN T Y. Rough set methods and applications: new developments in knowledge discovery in information systems [M]. Heidelberg. Germany: Physica-Verlag GmbH, 2000: 49-88.