Embed Size (px)
Citation preview
Extreme Learning Machines and Its
applications in Fault Detection
Yang Hu
Research Associate
ZHAW Zurich University of Applied Sciences
Institute for Data Analysis and Process Design (IDP)
2015.04.20
Outline
Extreme Learning Machines Theory
Comparison with SVM
Performance Analysis
Further Discussions
Extreme Learning Machines Theory
Single Layer Feedforward Neural Networks (SLFN)
Extreme Learning Machines Theory
Single Layer Feedforward Neural Networks (SLFN)
Extreme Learning Machines Theory
Single Layer Feedforward Neural Networks (SLFN)
Extreme Learning Machines Theory
Single Layer Feedforward Neural Networks (SLFN)
Learning Issues:
• Most effects are focus on how to adjust hidden nodes;
• Learning is somehow inefficiency
Question:
• Do we really need so many learning methods to iteratively train
the SLFN?
• How can we make learning efficient?
Extreme Learning Machines Theory
Extreme Learning Machines (ELM)
-- “Generalized” SLFN
h x
Lf x
Extreme Learning Machines Theory
h x
Lf x How to train ELM?
1
, ,L
L i i i
i
f G a b
x x H
Extreme Learning Machines Theory
How to train ELM? 1
, ,L
L i i i
i
f G a b
x x H
Equivalent ELM optimization formula:
ridge regression or
regularized least squares
0TELMLC
H T H
Extreme Learning Machines Theory
How to train ELM? 1
, ,L
L i i i
i
f G a b
x x H
Simple Math is Enough!
Extreme Learning Machines Theory
Extreme Learning Machines (ELM)
-- “Generalized” SLFN
Comparison with SVM
Support Vector Machine
Comparison with SVM
Support Vector Machine
– an Alternative Solution of SLFN
Comparison with SVM
Support Vector Machine
– an Alternative Solution of SLFN
Comparison with SVM
Support Vector Machine
– an Alternative Solution of SLFN
Comparison with SVM
Support Vector Machine
– an Alternative Solution of SLFN
Performance Analysis
Performance Analysis
Performance Analysis
Performance Analysis
ELM can always achieve comparable performance
as SVM and LS-SVM with much faster learning
speed, especially for the large dataset
Further Discussion
ELM-auto encoder for feature learning
Further Discussion
Deep ELM structure
Further Discussion
ELM vs Deep Learning on MINST dataset
ELM in fault detection
Signal reconstruction method
ELM in fault detection
Signal reconstruction method
ELM in fault detection
Residual plot using ELM and AAKR
ELM AAKR
ELM in fault detection
Summary
Extreme Learning Machines (ELM)
-- “Generalized” SLFN
Summary
Extreme Learning Machines (ELM)
-- “Generalized” SLFN
http://www.ntu.edu.sg/home/egbhuang/
All materials in this PPT related with ELM are coming from this website.
Guang-Bin Huang
Associate Professor
Nanyang Technological University, Singapore
Email: [email protected]
Phone: (+65)6790 4489
Office: S2.1-B2-06
