A Sequential Minimal Optimization Method for Optimization Extreme Learning Machine

您当前的位置：

首页 >

文章列表页 >

A Sequential Minimal Optimization Method for Optimization Extreme Learning Machine

更新时间：2025-07-09

- A Sequential Minimal Optimization Method for Optimization Extreme Learning Machine
- Vol. 45, Issue 6, Pages: 7-12+19(2011)
- 作者机构：
  
  西安交通大学电子与信息工程学院,西安,710049
- 作者简介：
- 基金信息：
- DOI：
  CLC： TP181
- Online First：10 June 2011，
  
  Published：2011
- 稿件说明：
移动端阅览
A Sequential Minimal Optimization Method for Optimization Extreme Learning Machine[J]. 2011, 45(6): 7-12+19.
DOI：

A Sequential Minimal Optimization Method for Optimization Extreme Learning Machine[J]. 2011, 45(6): 7-12+19. DOI：

摘要

针对传统二次规划求解方法训练优化极限学习机(OMELM)存在速度慢和效率低的问题

提出了单变量迭代序列最小优化(SSMO)算法.该算法通过在框式约束中优化拉格朗日乘子来实现目标函数的最小化:首先在初始化拉格朗日乘子中选择使目标函数值下降最大的拉格朗日乘子

将该拉格朗日乘子作为目标函数的唯一变量; 然后求解目标函数的最小值并更新该变量的值; 重复这个过程直到所有的拉格朗日乘子都满足二次规划问题的Karush-Kuhn-Tucker条件为止.实验结果表明:SSMO算法只需调节很少的参数值便可得到足够好的泛化性能; 采用SSMO算法的OMELM方法在泛化性能上要好于采用序列最小优化算法的支持向量机方法; 在随机数据集测试中

SSMO算法具有较好的鲁棒性.

Abstract

A sequential minimal optimization(SSMO)algorithm iterated with single variable is proposed to solve the slow speed and low efficiency problems in training optimization method based extreme learning machine(OMELM)by traditional quadratic programming solver. The algorithm searches the minimum value of the objective function by optimizing Lagrange multipliers within box constraints.The Lagrange multiplier that can generate maximum reduction in the objective function is selected from the initial Lagrange multipliers as for the unique variable of the objective function.Then the objective function is minimized with respect to the variable

and a new value of the Lagrange multiplier is obtained. The process is repeated until all Lagrange multipliers satisfy the Karush-Kuhn-Tucker condition of the quadratic programming problem.Experimental results show that SSMO algorithm can obtain good enough generalization performance with adjusting few parameter values.The generalization performance of OMELM method using SSMO algorithm is better than that of the support vector machine(SVM)method using sequential minimal optimization(SMO)algorithm.SSMO algorithm is robust in random datasets trails.

关键词

Keywords

references

HUANG Guangbin, ZHU Qinyu, SIEW C K. Extreme learning machine: theory and applications [J]. Neurocomputing, 2006, 70(1/2/3): 489-501.

HUANG Guangbin, ZHU Qinyu, SIEW C K. Real-time learning capability of neural networks [J]. IEEE Transactions on Neural Network, 2006, 17(2): 863-878.

程松, 闫建伟, 赵登福, 等. 短期负荷预测的集成改进极端学习机方法[J]. 西安交通大学学报, 2009, 43(2): 106-110.

CHENG Song, YAN Jianwei, ZHAO Dengfu, et al. Short-term load forecasting method based on ensemble improved extreme learning machine [J]. Journal of Xi'an Jiaotong University, 2009, 43(2): 106-110.

邓万宇, 郑庆华, 陈琳, 等. 神经网络极速学习方法研究[J]. 计算机学报, 2010, 33(2): 279-287.

DENG Wanyu, ZHENG Qinghua, CHEN Lin, et al. Research on extreme learning of neural networks [J]. Chinese Journal of Computers, 2010, 33(2): 279-287.

BARTLETT P L. The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network [J]. IEEE Transactions on Information Theory, 1998, 44(2): 525-536.

HUANG Guangbin, DING Xiaojian, ZHOU Hongming. Optimization method based extreme learning machine for classification [J]. Neurocomputing, 2010, 74(1/2/3): 155-163.

PLATT J. Fast training of support vector machines using sequential minimal optimization [M]∥Advances in Kernel Methods: Support Vector Learning. Cambridge, MA, USA: MIT Press, 1999: 185-208.

FLETCHER R. Practical methods of optimization: constrained optimization [M]. New York, USA: John Wiley and Sons, 1981: 2.

BLAKE C L, MERZ C J. UCI repository of machine learning databases [EB/OL].(1998-04-02)[2010-02-12]. http:∥www.ics.uci.edu/～mlearn/MLRepository.html.

MICHIE D, SPIEGELHALTER D J, TAYLOR C C. Machine learning, neural and statistical classification [M]. Englewood Cliffs, NJ, USA: Prentice Hall, 1994.

GHAUTY P, PAUL S, PAL N R. NEUROSVM: an architecture to reduce the effect of the choice of kernel on the performance of SVM [J]. Journal of Machine Learning Research, 2009, 10(3):591-622.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Disturbance Compensation and Decoupling Optimal Backstepping Control Strategy for Hypersonic Vehicle

New Algorithm of Fuzzy Support Vector Machine for Classification with Outliers

A New Recognition Method for Flotation Froth Images

Generalized Uniform Chebyshev Polynomial Kernel

Feature Exaction and Classification of Attention Related Electroencephalographic Signals Based on Sample Entropy

Related Author

TANG Weiqiang

CAI Yuanli

CHEN Zhichao

GAO Haiyan

段现报 1

马逸尘 1

张瑞 1

Related Institution

兰州理工大学电气工程与信息工程学院，730050，兰州College of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou 730050, China

西安交通大学自动化科学与工程学院，710049，西安School of Automation Science and Engineering, Xi'an Jiaotong University, Xi'an 710049, China

厦门市高端电力装备及智能控制重点实验室，361024，福建厦门Xiamen Key Laboratory of Frontier Electric Power Equipment and Intelligent Control, Xiamen, Fujian 361024, China

厦门理工学院电气工程与自动化学院，361024，福建厦门School of Electrical Engineering and Automation, Xiamen University of Technology, Xiamen, Fujian 361024, China

School of Mathematics and Information Science, Shandong University of Technology

⁰