By analyzing the invalidity reason of the local linear embedding(LLE)algorithm in case of the sparse data or the high noise data
small world neighborhood optimization LLE algorithm(SLLE)is proposed based on the complex networks theory. The data in LLE are optimized using the small world algorithm
and the shortest path and the local neighbor set clustering coefficients are used as the local parameters. As a result
the problem of the embedding distortion using only local linear patch of the manifold to define neighborhood in Euclidean space is effectively solved. Three groups of standard data sets are selected to test and to compare the efficiency and robustness of SLLE and LLE. The experimental results show that the calculation results
robustness and dimension reduction of SLLE are all better than those of LLE
and accuracy rate of SLLE is at least 10 percent higher than that of LLE.
关键词
Keywords
references
HASTIE T,TIBSHIRANI R,FREEDMAN J. The Element of statistical learning:data mining, inference,and prediction [M].Berlin, Germany:Springer,2001.
ROWEIS SS T, SAUL L K. Nonlinear dimensionality reduction by local linear embedding [J]. Science,2000,290(550):2323-2326.
TENENBAUM J B, SILVA V, LANGFORD J C. A global geometric framework for nonlinear dimensionality reduction [J]. Science,2000,290(550):2319-2323.
LAWRENCE K S, SAM T R. Think globally, fit locally:unsupervised learning of low dimensional manifolds [J]. Journal of Machine Learning Research,2003,4:119-155.
SHA F, SAUL L K. Analysis and extension of spectral methods for nonlinear dimensionality reduction [C]∥Proceedings of the 22nd International Conference on Machine Learning.New York, USA:ACM,2005:784-791.
MILGRAM S. The small world problem [J]. Psychology Today, 1967, 1(1):61-67.
WATTS D J, STROGATZ S H. Collective dynamics of small-world networks [J]. Nature, 1998, 393(4):440-442.
DU Haifeng, ZHUANG Jian, ZHANG Jinhua.Small-world phenomenon for function optimization [J].Journal of Xi'an Jiaotong University, 2005, 39(9):1011-1015.