|
|
Online Semi-Supervised Extreme Learning Machine Based on Manifold Regularization |
WANG Ping,WANG Di,FENG Wei |
(Department of Electrical Engineering and Automation, Tianjin University, Tianjin 300072, China) |
|
|
Abstract Abstract: In this paper, with the help of the rules of block matrix multiplication, an online semi-supervised extreme learning machine(OSSELM) was proposed according to semi-supervised extreme learning machine (SS-ELM) based on manifold regularization.By the analysis of the manifoldregularization term of the objective function of SSELM, a kind of approximation algorithm of OSS-ELM named OSS-ELM(buffer) was proposed to avoid running out of memory in the process of online learning.The linear relationship between the sample number and the cumulative running time of the OSS-ELM(buffer) was revealed in the experiments using Abalone and the relative deviation of the generalization ability of the OSSELM and the SS-ELM is less than 1% in 9 public data sets, which show that the OSSELM(buffer) not only solves the problem of limited memory, but also improves the speed of online learning while keeping the generalization ability of SSELM. This proves that the OSSELM(buffer)can be effectively applied to online semisupervised learning.
|
Received: 19 September 2014
Published: 31 August 2015
|
|
|
|
|
[1] |
LU Chengbo,MEI Ying. An Accurate and Robust Online Sequential Learning Algorithm for Feedforward Networks[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2015, 49(08): 1137-1143. |
[2] |
JI Liangbo. Precision Prediction Model in Fused Deposition Modeling of Three-Dimensional Printing Based on Wavelet Neural Network[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2015, 49(03): 375-378. |
[3] |
YANG Gang1, 2,QIAO Junfei1. Analysis of Span-Lateral Inhibition Neural Network and Its Application[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2014, 48(07): 965-970. |
[4] |
LING Xiao-Feng, GONG Xin-Bao, JIN Rong-Hong. Dynamic RBF Network Training Method Based on Immune Mechanism[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2012, 46(04): 642-645. |
[5] |
SUN Wang, LI Yan-Ming, DU Wen-Liao, YUAN Jin, LIU Cheng-Liang. State Performance Evaluation for the Main Pump Bearing of Pump Truck Based on Ant Colony Optimization of Neural Network[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2012, 46(04): 596-600. |
[6] |
ZHANG Jing,LUO Hanwen,JIN Ronghong(. A Hybrid Particle Filter for Symbol and Carrier Frequency Synchronization in MIMO Systems [J]. J. Shanghai Jiaotong Univ.(Sci.) , 2010, 44(02): 189-0192. |
[7] |
JIN Hui-liang,YUAN De-hu,YE Qian,XIE Wen-hua. yo-yo Motion Control by Oscillatory Neural Networks[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2008, 42(12): 1939-1942. |
[8] |
ZHANG Yingtang,MA Chao,LI Zhining,FAN Hongbo. Online Modeling of Kernel Extreme Learning Machine Based on Fast Leave-One-Out CrossValidation[J]. J. Shanghai Jiaotong Univ.(Sci.) , 2014, 48(05): 647-652. |
|
|
|
|