A novel constrained ant colony optimization algorithm is proposed for learning Bayesian networks. An add-edge-rule is designed in the proposed algorithm based on the locally consistent scoring criterion of BDEu metric. The add-edge-rule is embedded into the frame of ant colony optimization so that the heuristic information can be dynamically used to restrict the candidate evaluations during the search process and the running time of the new algorithm can be reduced. In addition
the correctness of the add-edge-rule is proved in theory and the parameter sensitivity of the constrained ant colony optimization is analyzed in experiments. Empirical tests show that without loss of results accuracy
the convergence speed of the proposed algorithm is at least 40% faster than that of the ant colony optimization algorithm for large-scale learning Bayesian networks.
关键词
Keywords
references
HECKERMAN D. Bayesian networks for data mining[J]. Data Mining and Knowledge Discovery,1997, 1(1): 79-119.
CHENG J, GREINER R, KELLY J, et al. Learning Bayesian networks from data: an information-theory based approach[J]. Artificial Intelligence, 2002, 137(1/2): 43-90.
DE CAMPOS L M, FERN N J M, MEZ G J A, et al. Ant colony optimization for learning Bayesian networks[J]. International Journal of Approximate Reasoning, 2002, 31(3): 291-311.
TSAMARDINOS I, BROWN L E, ALIFERIS C F. The max-min hill-climbing Bayesian network structure learning algorithm[J]. Machine Learning, 2006, 65(1): 31-78.
JI J, ZHANG H, HU R, et al. Bayesian network learning algorithm based on independence test and ant colony optimization[J]. Acta Automatica Sinica, 2009, 35: 281-288.
CHICKERING D M. Optimal structure identification with greedy search[J]. The Journal of Machine Learning Research, 2003, 3: 554.
DORIGO M, MANIEZZO V, COLORNI A. Ant system: optimization by a colony of cooperating agents[J]. Systems, Man, and Cybernetics: Part B Cybernetics, 2002, 26(1): 29-41.
ZHANG Yun, Feng Boqin, MA Shouqiang, et al. Text clustering based on fusion of ant colony and genetic algorithms[J]. Journal of Xi'an Jiaotong University, 2007, 41(10): 1146-1150.
ZHENG Wei, LIU Sanyang, KOU Xiaoli. A route restoration algorithm for sensor network via ant colony optimization[J]. Journal of Xi'an Jiaotong University, 2010, 44(1): 83-86.
ZHANG Zhaojun, FENG Zuren, REN Zhigang. Novel ant colony optimization algorithm based on order optimization[J]. Journal of Xi'an Jiaotong University, 2010, 44(2): 15-19.
DE CAMPOS L M, PUERTA J M. Stochastic local and distributed search algorithms for learning belief networks[C]∥Proceedings of the III International Symposium on Adaptive Systems: Evolutionary Computation and Probabilistic Graphical Model. Havana, Cuba: ICIMAF, 2001: 109-115.
HECKERMAN D, GEIGER D, CHICKERING D M. Learning Bayesian networks: the combination of knowledge and statistical data[J]. Machine Learning, 1995, 20(3): 197-243.
GAMES J A, MATEO J L, PUERTA J M. Learning Bayesian networks by hill climbing: efficient methods based on progressive restriction of the neighborhood[J]. Data Mining and Knowledge Discovery, 2011,22(1): 106-148.