Accession Number : AD1015871


Title :   Use Correlation Coefficients in Gaussian Process to Train Stable ELM Models


Descriptive Note : Conference Paper


Corporate Author : College of Computer Science and Software Engineering, Shenzhen University Shenzhen China


Personal Author(s) : He,Yulin ; Huang,Joshua Z ; Wang,Xizhao ; Raza,Rana A


Full Text : http://www.dtic.mil/dtic/tr/fulltext/u2/1015871.pdf


Report Date : 22 May 2015


Pagination or Media Count : 13


Abstract : This paper proposes a new method to train stable extreme learning machines (ELM). The new method, called StaELM, uses correlation coefficients in Gaussian process to measure the similarities between different hidden layer outputs. Different from kernel operations such as linear or RBF kernels to handle hidden layer outputs, using correlation coefficients can quantify the similarity of hidden layer outputs with real numbers in (0, 1] and avoid covariance matrix in Gaussian process to become a singular matrix. Training through Gaussian process results in ELM models insensitive to random initialization and can avoid over-fitting. We analyse the rationality of StaELM and show that existing kernel-based ELMs are special cases of StaELM. We used real world datasets to train both regression and classification StaELM models. The experiment results have shown that StaELM models achieved higher accuracies in both regression and classification in comparison with traditional kernel-based ELMs. The StaELM models are more stable with respect to different random initializations and less over-fitting. The training process of StaELM models is also faster.


Descriptors :   learning machines , ARTIFICIAL NEURAL NETWORKS , GAUSSIAN PROCESSES


Distribution Statement : APPROVED FOR PUBLIC RELEASE