Upload
sherinpm
View
228
Download
0
Embed Size (px)
Citation preview
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 1/21
27-Jan-15 1
Soft computing
BY:
ARUN PRASAD K.M.
Assistant Professor
Model Engineering College
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 2/21
27-Jan-15 2
Soft computing techniques
Artificial Neural Networks (ANN)
Fuzzy Logic
Genetic Algorithms
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 3/21
27-Jan-15 3
Reference Books
• S.N. Shivnandam, “Principle of soft computing”,
Wiley.
• S. Rajshekaran and G.A.V. Pai, “Neural Network
, Fuzzy logic And Genetic Algorithm”, PHI. • Jack M. Zurada, “Introduction to Artificial Neural
Network System” JAico Publication.
• Simon Haykins, “Neural Network- AComprehensive Foudation”
• Timothy J.Ross, “Fuzzy logic with Engineering
Applications”, McGraw-Hills 1.
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 4/21
27-Jan-15 4
Artificial neural network
Human brain is a highly complex, nonlinear,
and parallel information processing system
Human Brain is made up of cells called Neurons
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 5/21
Syllabus
27-Jan-15 5
Module 1
Introduction to Neural Network: Concept,
biological neural network, evolution of artificialneural network, McCulloch-Pitts neuron models,
Learning (Supervise & Unsupervise) and activation
function, Models of ANN-Feed forward network and
feed back network, Learning Rules- Hebbian,
Delta, Perceptron Learning and Windrow-Hoff,
winner take all.
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 6/21
Human brain contains
a massively
interconnected net of
10 10 -10 11 (10 billion)
neurons (cortical
cells)
Biological
Neuron
- The simple
“arithmetic
computing”
element
Brain Computer: What is it?
6
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 7/21
27-Jan-15 7
BIOLOGICAL NEURON
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 8/21
27-Jan-15 8
BIOLOGICAL NEURON
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 9/21
27-Jan-15 9
BIOLOGICAL NEURON
• In the human brain, a typical neuron collectssignals from others through a host of finestructures called dendrites.
• The neuron sends out spikes of electrical
activity through a long, thin strand known asan axon, which splits into thousands ofbranches.
• At the end of each branch, a structure called
a synapse converts the activity from theaxon into electrical effects that inhibit orexcite activity from the axon into electricaleffects in the connected neurons.
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 10/21
27-Jan-15 10
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 11/21
27-Jan-15 11
The Artificial Neuron model
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 12/21
27-Jan-15 12
The analogy between HUMAN
NEURON and the ANN
Human Artificial
Neuron Processing Element
Dendrites Combining Function
Cell Body Transfer Function
Axons Element Output
Synapses Weights
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 13/21
27-Jan-15 13
Activation Functions
1. Threshold
2. Signum
3. Sigmoid4. Hyperbolic tangent (tanh)
5. Piece-wise linear
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 14/21
27-Jan-15 14
1.Threshold function
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 15/21
27-Jan-15 15
2.Signum Function
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 16/21
27-Jan-15 16
3.Sigmoid Function
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 17/21
27-Jan-15 17
4.Hyperbolic Tangent
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 18/21
27-Jan-15 18
5.Piece wise linear
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 19/21
27-Jan-15 19
Applications of Artificial
Neural Networks
• Speech Recognition• Pattern Recognition
• Signal processing
• Text to speech Conversion• Robotics
• Control
• Medical diagnosis
• Stock Market Prediction
• Sales Forecasting
• Energy Demand Forecasting
• Parameter Estimation
7/24/2019 Soft Computing Class1
http://slidepdf.com/reader/full/soft-computing-class1 20/21
27-Jan-15 20
Mc Culloch and Pitts Model
For Mc-Culloch & Pitts Model, the activation function is
Threshold or signum