Aiming at the problem that classical Euclidean distance metric may be invalid when it is used to measure the complicated data structures
a manifold distance based on similarity metric and being able to measure the geodesic distance along the manifold is introduced
and a criterion function used to express the clustering target is designed
where the samples in the same cluster are somehow more similar than samples in different one. Accordingly
the clustering problem is converted to function optimization problem
and an iterative optimization clustering algorithm is proposed. The steps of the algorithm are discussed in detail. Simulation results on four artificial datasets with different manifold structures show that the new algorithm is more straightforward due to the less pre-defined parameters and it is a deterministic algorithm due to the lack of random operations. A comparison with k-means clustering algorithms indicates the ability to determine the cluster number automatically and identify complex non-convex clusters.
关键词
Keywords
references
DUDA R O, HART P E, STORK D G. Pattern classification [M]. New York, USA: Wiley, 2001:538-548.
SU Muchu, CHOU C H. A modified version of the k-means algorithm with a distance based on cluster symmetry [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2001, 23(6): 674-680.
ZHOU Dengyong, BOUSQUET O, LAL T N, et al. Learning with local and global consistency [C]∥Advances in Neural Information Processing Systems:16. Cambridge, USA: MIT Press, 2004:321-328.
TENENBAUM J B, DE SILVA V, LANGFORD J C. A global geometric framework for nonlinear dimensionality reduction [J]. Science, 2000, 290(550): 2319-2323.
SHAKHNAROVICH G, DARRELL T, INDYK P. Nearest-neighbor methods in learning and vision [M]. Cambridge, USA: MIT Press, 2005.
FLOYD R W. Algorithm 97: shortest path [J]. Communications of the ACM, 1962, 5(6): 345.
MACQUEEN J B.Some methods for classification and analysis of multivariate observations[C]∥The 5th Berkeley Symposium on Mathematical Statistics and Probability. Berkeley, USA: Univ of Calif Press, 1967: 281-297.