21
27-Jan-15 1 Soft computing BY: ARUN PRASAD K.M. Assistant Professor Model Engineering College

Soft Computing Class1

Embed Size (px)

Citation preview

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 1/21

27-Jan-15 1

Soft computing

BY:

ARUN PRASAD K.M.

Assistant Professor

Model Engineering College

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 2/21

27-Jan-15 2

Soft computing techniques

Artificial Neural Networks (ANN)

Fuzzy Logic

Genetic Algorithms

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 3/21

27-Jan-15 3

Reference Books

• S.N. Shivnandam, “Principle of soft computing”,

Wiley.

• S. Rajshekaran and G.A.V. Pai, “Neural Network

, Fuzzy logic And Genetic Algorithm”, PHI. • Jack M. Zurada, “Introduction to Artificial Neural

Network System” JAico Publication. 

• Simon Haykins, “Neural Network- AComprehensive Foudation” 

• Timothy J.Ross, “Fuzzy logic with Engineering

 Applications”, McGraw-Hills 1.

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 4/21

27-Jan-15 4

Artificial neural network

Human brain is a highly complex, nonlinear,

and parallel information processing system 

Human Brain is made up of cells called Neurons

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 5/21

Syllabus

27-Jan-15 5

Module 1 

Introduction to Neural Network: Concept,

biological neural network, evolution of artificialneural network, McCulloch-Pitts neuron models,

Learning (Supervise & Unsupervise) and activation

function, Models of ANN-Feed forward network and

feed back network, Learning Rules- Hebbian,

Delta, Perceptron Learning and Windrow-Hoff,

winner take all.

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 6/21

Human brain contains

a massively

interconnected net of

10 10 -10 11  (10 billion)

neurons (cortical

cells)

Biological

Neuron

- The simple

“arithmetic

computing”

element

Brain Computer: What is it?

6

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 7/21

27-Jan-15 7

BIOLOGICAL NEURON

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 8/21

27-Jan-15 8

BIOLOGICAL NEURON

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 9/21

27-Jan-15 9

BIOLOGICAL NEURON

• In the human brain, a typical neuron collectssignals from others through a host of finestructures called dendrites.

• The neuron sends out spikes of electrical

activity through a long, thin strand known asan axon, which splits into thousands ofbranches.

• At the end of each branch, a structure called

a synapse converts the activity from theaxon into electrical effects that inhibit orexcite activity from the axon into electricaleffects in the connected neurons.

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 10/21

27-Jan-15 10

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 11/21

27-Jan-15 11

The Artificial Neuron model

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 12/21

27-Jan-15 12

The analogy between HUMAN

NEURON and the ANN 

Human Artificial

 Neuron Processing Element

Dendrites Combining Function

Cell Body Transfer Function

Axons Element Output

Synapses Weights

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 13/21

27-Jan-15 13

Activation Functions

1. Threshold

2. Signum

3. Sigmoid4. Hyperbolic tangent (tanh)

5. Piece-wise linear

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 14/21

27-Jan-15 14

1.Threshold function

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 15/21

27-Jan-15 15

2.Signum Function

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 16/21

27-Jan-15 16

3.Sigmoid Function

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 17/21

27-Jan-15 17

4.Hyperbolic Tangent

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 18/21

27-Jan-15 18

5.Piece wise linear

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 19/21

27-Jan-15 19

Applications of Artificial

Neural Networks

• Speech Recognition• Pattern Recognition

• Signal processing

• Text to speech Conversion• Robotics

• Control

• Medical diagnosis

• Stock Market Prediction

• Sales Forecasting

• Energy Demand Forecasting

• Parameter Estimation

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 20/21

27-Jan-15 20

Mc Culloch and Pitts Model

For Mc-Culloch & Pitts Model, the activation function is

Threshold or signum

7/24/2019 Soft Computing Class1

http://slidepdf.com/reader/full/soft-computing-class1 21/21

27-Jan-15 21