An improved K-means algorithm to auto-determine the clustering number by using gravity is proposed to solve the problems that one needs to specify the number of clusters in the traditional K-means algorithm and it is easy to fall into local optimum. The orthogonal design method is used to uniformly place several detectors into the data space
and then these detectors are moved according to the law of universal gravitation. When two detectors's distance less than the given threshold
they are merged. The number of detectors is just the number of the clusters when the algorithm converges. Then the resulting detectors are used as the initial center points to avoid the local optimum. Experimental results and comparisons with the traditional K-means algorithm show that the proposed method can automatically determine the number of clusters and gives the better initial centers
and that the iteration number of the algorithm is reduced by at least 25% and clustering accuracy is increased by an average of 14% and the performance evaluation DB(Davies and Bouldin)index is reduced by an average of 0.19.
关键词
Keywords
references
PENA J M, LOZANO J A, LARRANAGA P. An empirical comparison of four initialization methods for the K-means algorithm[J]. Pattern Recognition Letters, 1999, 20(10): 1027-1040.
MACQUEEN J. Some methods for classification and analysis of multivariate observations[C]∥Proceedings of the 5th Berkeley Symposium on Mathematical Statistics and Probability. Berkeley, USA: University of California Press, 1967: 281-297.
ESTIVILL C V, YANG Jianhua. Fast and robust general purpose clustering algorithms[J]. Data Mining and Knowledge Discovery, 2004, 8(2): 127-150.
SU Muchun, CHOU Chienhsing. A modified version of the K-means algorithm with a distance based on cluster symmetry[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(6): 674-680.
LIKAS A, VLASSIS M, VERBEEK J. The global K-means clustering algorithm[J]. Pattern Recognition, 2003, 36(2): 451-461.
D'URSO P, GIORDANI P. A robust fuzzy K-means clustering model for interval valued data[J]. Computational Statistics, 2006, 21(2): 251-269.
HUA Chunsheng, CHEN Qian, WU Haiyuan, et al. RK-means clustering: K-means with reliability[J]. IEICE Transactions on Information and Systems, 2008, E91-D(1): 96-104.
TIMMERMAN M E, CEULEMANS E, DE R, et al. Subspace K-means clustering[J]. Behavior Research Methods, 2013, 45(4): 1011-1023.
PELLEG D, MOORE A. X-means: extending K-means with efficient estimation of the number of clusters[C]∥Proceedings of the 17th International Conference on Machine Learning. New York, USA: ACM, 2000: 727-734.
HAMERLY G, ELKAN C. Learning the k in K-means[C]∥Proceedings of the 17th Annual Conference on Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2003: 281-288.
KALOGERATOS A, LIKAS A. Dip-means: an incremental clustering method for estimating the number of clusters[C]∥Proceedings of the 6th Annual Conference on Neural Information Processing Systems. Cambridge, MA, USA: MIT Press, 2012: 2402-2410.
BAGIROV A M, UGON J, WEBB D. Fast modified global k-means algorithm for incremental cluster construction[J]. Pattern Recognition, 2011, 44(4): 866-876.
TZORTZIS G, LIKAS A. The minmax k-means clustering algorithm[J]. Pattern Recognition, 2014, 47(7): 2505-2516.
LEUNG Yiuwing, WANG Yuping. An orthogonal genetic algorithm with quantization for global numerical optimization[J]. IEEE Transactions on Evolutionary Computation, 2001, 5(1): 41-53.
DAVIES D L, BOULDIN D W. A cluster separation measure[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1979, 1(2): 224-227.