西安交通大学电气工程学院,西安,710049
网络首发:2009-10-10,
纸质出版:2009
移动端阅览
司刚全, 曹晖, 张彦斌, 等. 一种基于密度加权的最小二乘支持向量机稀疏化算法[J]. 西安交通大学学报, 2009,43(10):11-15.
Density Weighted Pruning Method for Sparse Least Squares Support Vector Machines[J]. 2009, 43(10): 11-15.
针对最小二乘支持向量机失去标准支持向量机稀疏特性的问题
提出了一种基于密度加权的稀疏化算法.首先计算样本的密度信息
对样本估计误差进行密度加权获得该样本对模型的可能贡献度; 然后选取具有最大可能贡献度的样本作为支持向量
同时对支持向量样本邻域内的其他样本密度信息进行削减
从而避免相似样本被选中为支持向量; 再选择剩余样本中具有最大可能贡献度的样本添加到支持向量集中
直到模型性能满足要求.仿真和实际应用表明
与Suykens提出的标准稀疏化算法相比
所提出的算法能有效剔除冗余支持向量
具有更好的稀疏性和鲁棒性.
For lack of sparseness characteristic in support vector machines(SVM)by least squares solution(LSSVM)
a density weighted pruning algorithm to improve the sparseness of the LSSVM regression model is investigated. The estimation error of training sample is weighted by corresponding density value and the potential contribution of training sample is obtained. Then the sample with the greatest value in the sorted spectrum of the potential contribution is selected as the support vector. The density and the potential contribution of training sample are updated and the potential contribution of the neighborhood sample of support vectors is significantly reduced. Thus the rechoosing of similar sample as support vector is properly avoided. More support vectors in the training sample set are iteratively selected
until the user-defined performance is achieved
thus the sparse LSSVM model is obtained. The simulation and practical applications indicate that the proposed method performs more effectively than Suykens standard sparse method for removing the redundant support vector with better sparseness and robustness.
SUYKENS J A K, DE BRABANTER J, LUKAS L, et al. Weighted least squares support vector machines: robustness and sparse approximation [J]. Neurocomputing, 2002, 48(1/4): 85-105.
DE KRUIF B J, DE VRIES T J A. Pruning error minimization in least squares support vector machines [J]. IEEE Transactions on Neural Networks, 2003, 14(3):696-702.
MILLER A J. Subset selection in regression [M].2nd ed. Boca Raton, USA: Chapman Hall/CRC Press, 1990.
CHEN S, COWAN C, GRANT P. Orthogonal least squares learning algorithm for radial basis function networks[J]. IEEE Transactions on Neural Networks, 1991, 2(2):302-309.
BAUDAT G, ANOUAR F. Kernel based methods and function approximation[C]∥Proceedings of IJCNN'01. Washington DC,USA: IEEE Press, 2001:1244-1249.
KOLACZ J. Measurement system of the mill charge in grinding ball mill circuits[J]. Minerals Engineering, 1997, 10(12):1329-1338.
SI Gangquan, CAO Hui, ZHANG Yanbin, et al. Ball mill load measurement using self-adaptive feature extraction method and LS-SVM model[C]∥Proceedings of ICIC 2008. Shanghai, China: Springer-Verlag Press, 2008:275-284.
0
浏览量
6
下载量
7
CSCD
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621