Aiming at the problem of the basic prediction algorithm with relative low prediction accuracy
a novel and improved prediction algorithm NLWEPrediction is proposed based on non-linear weighted and ensemble learning. It combines the advantages of linear ensemble learning and the relationship between the base predict algorithms
which corrects the prediction deviation and uses gradient descent method to calculate the model parameters. The experiments proved that the NLWEPrediction's mean squared error in datasets is lower than 250
and the mean absolute difference is lower than 13. The algorithm was compared with its four base prediction algorithms
other two ensemble prediction algorithms Bagging and Stacking and original NLWEPrediction for efficiency analysis. Experimental results showed that NLWEPrediction has obviously low mean square error and average absolute error. The prediction accuracy is improved. So
adding the nonlinear regression terms can improve the capability of ensemble classifier.
关键词
Keywords
references
HE Liang, SONG Qinbao, SHEN Junyi. Boosting-based k-NN learning for software defect prediction [J]. Pattern Recognition and Artificial Intelligence, 2012, 25(5): 792-802.
RZTEBLATT Ä D. Linear regression analysis: part 14 of a series on evaluation of scientific publications [J]. Deutsches Ärzteblatt Archiv Medizin Übersichtsarbeit, 2010, 107(44): 776-782.
UMAR S N. Software testing defect prediction model: a practical approach [J]. International Journal of Research in Engineering and Technology, 2013, 2(5): 741-745.
YANG J F, ZHAI Y J, XU D P, et al. SMO algorithm applied in time series model building and forecast [C]∥International Conference on Machine Learning and Cybernetics. Piscataway, NJ, USA: IEEE, 2007: 2395-2400.
ROBERTS S, OSBORNE M, EBDEN M, et al. Gaussian processes for time-series modelling [J]. Philosophical Transactions of the Royal Society A, 2013, 371(1984): 20110550.
AUDIBERT J Y. Bagging predictors [J]. Annales De Linstitut Henri Poincare Probability Statistics, 2004, 40(6): 685-736.
SILL J, TAKACS G, MACKEY L, et al. Feature-weighted linear stacking [EB/OL]. [2016-12-12]. https:∥arxiv.org/pdf/0911.0460.pdf.
ADHIKARI R, AGRAWAL R K. A novel weighted ensemble technique for time series forecasting [J]. Lecture Notes in Computer Science, 2012, 7301: 38-49.
NESTEROV Y. Introductory lectures on convex optimization [M]. Berlin, Germany: Springer, 2014: 16-38.