Considering the existence of significant difference among the training samples
a weighted solution path algorithm for support vector regression is proposed in which the error penalty parameter on each training sample is weighted differently. The weighting coefficients are obtained by using piecewise linear interpolation based on the difference of samples' importance. Then the solution path is adjusted by the resulting weighting coefficients
such that the effects of different samples in regression model are changed correspondingly. The experiments on the prediction of response data of cylinder structure under two different boundary conditions in time frequency domain
where the importance of each training sample is characterized by the geometrical distance to the test sample
show that the weighted solution path algorithm for support vector regression can reduce prediction errors of displacement response on different evaluation indexes
and that the generalization of regression model is improved. It is noted that the main idea of the proposed algorithm can also be applied to other solution path algorithms
such as λ-path and ν-SVR path algorithms.
关键词
Keywords
references
ROSSET S, ZHU J. Piecewise linear regularized solution paths[J]. Annals of Statistics, 2007, 35(3): 1012-1030.
DU Shuxin, WU Tiejun. Weighted support vector machines for regression and its application [J]. Journal of Zhejiang University(Engineering Science), 2004, 38(3): 302-306.
TOY F E H, CAO L J. Modified support vector machines in financial time series forecasting [J]. Neurocomputing, 2002,48(1/4): 847-861.
ZHU J, ROSSET S, HASTIE T, et al. 1-norm support vector machines [C]∥Advances in Neural Information Processing Systems. Cambridge,USA: MIT Press, 2004: 49-56.
HASTIE T, ROSSET S, TIBSHIRANI R, et al. The entire regularization path for the support vector machine[J]. Journal of Machine Learning Research,2004, 5:1391-1415.
GUNTER L, ZHU J. Efficient computation and model selection for the support vector regression [J]. Neural Computation, 2007, 19(6): 1633-1655.
WANG G, YEUNG D Y, LOCHOVSKY F H. Two dimensional solution path for support vector regression[C]∥Proceedings of the 23rd International Conference on Machine Learning. New York, USA: ACM Press, 2006: 993-1000.