Least Squares Support Vector Machine Parameters Optimization Based on Improved Fruit Fly Optimization Algorithm with Applications[J]. 2017, 51(6): 14-19.
DOI:
Least Squares Support Vector Machine Parameters Optimization Based on Improved Fruit Fly Optimization Algorithm with Applications[J]. 2017, 51(6): 14-19.DOI: 10.7652/xjtuxb201706003.
Least Squares Support Vector Machine Parameters Optimization Based on Improved Fruit Fly Optimization Algorithm with Applications
Considering the blind hyper parameters selection in least squares support vector machine(LSSVM)modeling
a new improved fruit fly optimization algorithm(IFOA)for hyper parameter optimization is proposed based on the conventional FOA. This algorithm selects the different step size formula to realize the adaptive update of the search step by judging the relation between the optimal value obtained by contemporary optimization and the previous generation optimal value
which improves the optimization precision and global optimization ability of the IFOA with fewer parameters and quick calculation rate. The simulation and mill load softsensing application show that the prediction model based on IFOA
compared with those based on grid search method
particle swarm optimization algorithm and FOA
significantly improves the mill load forecast precision and more accurately reveals the change rule of mill load.
关键词
Keywords
references
DUAN K, KEERTHI S S, POO A N. Evaluation of simple performance measures for tuning SVM hyperparameters [J]. Neurocomputing, 2003, 51(4): 41-49.
KERRTHI S S. Efficient tuning of SVM hyperpara-meters using radius/margin bound and iterative algorithms [J]. IEEE Trans on Neural Networks, 2002, 13(5): 1225-1229.
TAO Shaohui, CHEN Dezhao, HU Wangming. Gradient algorithm for selecting hyper parameters of LSSVM in process modeling [J]. Journal of Chemical Industry and Engineering, 2007, 58(6); 1514-1517.
GOLD C, SOLLICH P. Model selection for support vector machine classification [J]. Neurocomputing, 2003, 55(1/2): 221-249.
AN S, LIU W, VENKATESH S. Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression [J]. Pattern Recognition, 2007, 40: 2154-2162
GUO Yinan, CHENG Jian, YANG Mei. Selection method for hyper-parameters of support vector regression by chaotic cultural algorithm [J]. Control and Decision, 2010, 25(4): 525-530.
ZHAO Zhuanzheng, LI Yunxiang. Text categorization model based on CS-LSSVM optimized by cuckoo search algorithm [J]. Computer Engineering and Applications, 2013, 49(16): 124-128.
DONG Jianda, SUN Zhineng, ZHOU Kaihe, et al. Identification of lighting over-voltage based on particle swarm optimizing algorithm and least square support vector machine [J]. Power System and Clean Energy, 2016, 32(6): 35-41.
WANG Huizhong, ZHOU Jia, WANG Yuefeng, et al. LSSVM in short-term load forecasting based on fruit fly optimization algorithm [J]. Power System and Automation, 2015, 37(6): 60-63.
SI Gangquan, CAO Hui, ZHANG Yanbin, et al. Density weighted pruning method for sparse least squares support vector machines [J]. Journal of Xi'an Jiaotong University, 2009, 43(10): 11-15.
TANG Jian, ZHAO Lijie, YUE Heng, et al. Present status ang future developments of detection method for mill load [J]. Control Engineering of China, 2010, 17(5): 565-574.
TANG Jian, ZHAO Lijie, YUE Heng, et al. Soft sensor for ball mill load based on multi-source data feature fusion [J]. Journal of Zhejiang University(Engineering Science), 2010, 44(7): 1406-1413.