Based on the idea of Watts-Strogatz(W-S)network model
a multilayer feedforward small world neural network
which relies heavily on the rewiring probability
is constructed by reconnecting the regular links. The network model is described mathematically
and the function approximation and network fault-tolerance simulations are employed to investigate the performances of small world neural network. The results show that the small world neural network is endowed with better approximation performance compared with the regular or random connecting network; and when the learning rate parameter of network gets between 0.1 to 0.3
it exerts less impact on the approximation performance of small world neural network. In addition
when the network weight failure is less than 30%
small world neural network with rewiring probability less than 0.8 and regular network have the same better performance on fault-tolerance. When failure rate is more than 40%
small world neural network with high rewiring probability and random connecting neural network have distinctly better performance on fault-tolerance than the regular neural network has.
关键词
Keywords
references
李翔. 从复杂到有序:神经网络智能控制理论新进展[M]. 上海:上海交通大学出版社, 2006.
SPORNS O, HONEY C J. Small worlds inside big brains [J]. Proceedings of the National Academy of Sciences of the United States of America, 2006,103(51):19219-19220.
YUAN Zhuzhi, CHEN Zengqiang, LI Xiang. Connectionism intelligent control: a survey [J]. Acta Automatica Sinica, 2002,28(1):38-59.
XIA Y S, WANG J. A general methodology for designing globally convergent optimization neural networks [J]. IEEE Trans on Neural Networks, 1998,9(6):1331-1343.
MURATA N. Network information criterion determining the number of hidden units for an artificial neural network model [J]. IEEE Trans on Neural Networks, 1994, 5(6):865-872.
HORNIK K, STINCHCOMBE M, WHITE H. Multilayer feedforward networks are universal approximators [J]. Neural Networks, 1989,2(2):359-366.
WATTS D J, STROGATZ S H. Collective dynamics of small-world networks [J]. Nature, 1998,393(4): 440-442.
ALBERT R, BARABA'SI A L. Statistical mechanics of complex networks [J]. Reviews Modern Physics, 2002,74(1):47-97.
DU Haifeng, ZHUANG Jian, ZHANG Jinhua, et al. Small-world phenomenon for function optimization [J]. Journal of Xi'an Jiaotong University, 2005,39(9):1011-1015.
SPORNS O, TONONI G, EDELMAN G M. Connectivity and complexity: the relationship between neuroanatomy and brain dynamics [J]. Neural Networks, 2000,13(8):909-922.
BASSETT D S, BULLMORE E. Small-world brain networks [J]. Neuroscientist, 2006,12(6):512-523.
SIMARD D, NADEAU L, KROGER H. Faster learning in small-world neural networks [J]. Physics Letters: A, 2005,336(1):8-15.
杜海峰, 李树茁, MARCUS W F, 等. 基于先验知识和模块性的网络社区结构探测算法 [J]. 西安交通大学学报, 2007,41(6):750-754.
DU Haifeng, LI Shuzhuo, MARCUS W F, et al. Detecting algorithm based on prior knowledge and modularity for networked community structure [J]. Journal of Xi'an Jiaotong University, 2007,41(6): 750-754.
KLEINBERG J. The small-world phenomenon and decentralized search [J]. SIAM News, 2004,37(3):1-3.