COST B27 Working Group 3 MK national report Georgi Stojanov Faculty of Electrical Engineering...

Preview:

DESCRIPTION

WG3 COST B27 MK national report, Istanbul, September /20 Contingent Negative Variation (CNV) Experimental setup for the CNV experiments

Citation preview

COST B27Working Group 3 MKnational report

Georgi Stojanov

Faculty of Electrical EngineeringUniversity of SS Cyril and Methodius in Skopje, Macedonia

WG3 COST B27 MK national report, Istanbul, September 3. 2005

TALK OUTLINE

PREVIOUS EXPERIENCE CNV and DCNV extraction and recognition EEG controlled devices

ONGOING RESEARCH representation of knowledge of the

environment in autonomous agents Behavior of human subjects in simple virtual

environments WG3 MK ROLE IN COST B27

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Contingent Negative Variation (CNV)

s1 s2

reaction

record EEG

subject

Experimental setup for the CNV experiments

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Contingent Negative Variation (CNV)

Typical CNV wave recorded from Cz electrode. By convention negative EEG values are up

WG3 COST B27 MK national report, Istanbul, September 3. 2005

CNV extraction using classical averaging

trials time

S1 S2

WG3 COST B27 MK national report, Istanbul, September 3. 2005

DYNAMIC CNV EXPERIMENTAL SETUP (DCNV)

subject

s1

reaction

record EEG

if i(cnv)>t and s2 then s2:=Fif i(cnv)<t and ~s2 then s2:=T

WG3 COST B27 MK national report, Istanbul, September 3. 2005

DYNAMIC CNV EXPERIMENTAL SETUP (DCNV)

WG3 COST B27 MK national report, Istanbul, September 3. 2005

EXTRACTION OF CNV WAVE DURING CLASSIC AND DCNV SETUP

( ) ( ) ( ) ( ) ( )

_

( )

_

n n

i

ni

ni

n nf f s n s nE E

( )

_

nn 0

( ) ( )

_

n nf s

_

( )( )n ps f

n

i

i

p

1

1

^

( ) ( ) ( )( ) , ...n Hs f f fn

1 2 1

^

( ) ( )( )ns h fii

n

n i

1

( ) ( ) ( )

^ ^k k ks c s d f

1

…….

)()(

ikfcoi

i

k ds

CNV DCNV

WG3 COST B27 MK national report, Istanbul, September 3. 2005

TALK OUTLINE

PREVIOUS EXPERIENCE CNV and DCNV extraction and recognition EEG controlled devices

ONGOING RESEARCH representation of knowledge of the

environment in autonomous agents Behavior of human subjects in simple virtual

environments WG3 MK ROLE IN COST B27

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Behavior of human subjects in simple simulated environment

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Behavior of human subjects in simple simulated environment

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Behavior of human subjects in simple simulated environment

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Behavior of human subjects in simple simulated environment

WG3 COST B27 MK national report, Istanbul, September 3. 2005

Behavior of human subjects in simple simulated environment

WG3 COST B27 MK national report, Istanbul, September 3. 2005

EXPERIMENTAL RESULTSVISUAL AND AUDITORY STIMULI

(8 subjects grand average)

y = -31,777x + 488,74 r2=0.84

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13TIMES THE GOAL WAS REACHED

VISUAL STIMULI ONLY(8 subjects grand average)

y = -13,333x + 584,6 r2=0.68

0200400600800

1 2 3 4 5 6 7 8 9 10 11TIMES THE GOAL WAS REACHED

AUDITORY STIMULI ONLY (7 subjects grand average)

y = -23,97x + 426,44 r2=0.68

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13 14TIMES THE GOAL WAS REACHED

learning was much faster for compound stimuli (slope= -31.8) than only auditory (slope= -23.0) or only visual (slope= -13.3) stimuli. The compound versus simple percept discrepancy was predicted by the model.

WG3 COST B27 MK national report, Istanbul, September 3. 2005

AUDITORY STIMULI ONLY

AUDITORY STIMULI ONLY (7 subjects grand average)

y = -23,97x + 426,44 r2=0.68

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13 14TIMES THE GOAL WAS REACHED

WG3 COST B27 MK national report, Istanbul, September 3. 2005

EXPERIMENTAL RESULTSVISUAL AND AUDITORY STIMULI

(8 subjects grand average)

y = -31,777x + 488,74 r2=0.84

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13TIMES THE GOAL WAS REACHED

VISUAL STIMULI ONLY(8 subjects grand average)

y = -13,333x + 584,6 r2=0.68

0200400600800

1 2 3 4 5 6 7 8 9 10 11TIMES THE GOAL WAS REACHED

AUDITORY STIMULI ONLY (7 subjects grand average)

y = -23,97x + 426,44 r2=0.68

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13 14TIMES THE GOAL WAS REACHED

learning was much faster for compound stimuli (slope= -31.8) than only auditory (slope= -23.0) or only visual (slope= -13.3) stimuli. The compound versus simple percept discrepancy was predicted by the model.

WG3 COST B27 MK national report, Istanbul, September 3. 2005

VISUAL STIMULI ONLY

VISUAL STIMULI ONLY(8 subjects grand average)

y = -13,333x + 584,6 r2=0.68

0200400600800

1 2 3 4 5 6 7 8 9 10 11TIMES THE GOAL WAS REACHED

WG3 COST B27 MK national report, Istanbul, September 3. 2005

EXPERIMENTAL RESULTSVISUAL AND AUDITORY STIMULI

(8 subjects grand average)

y = -31,777x + 488,74 r2=0.84

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13TIMES THE GOAL WAS REACHED

VISUAL STIMULI ONLY(8 subjects grand average)

y = -13,333x + 584,6 r2=0.68

0200400600800

1 2 3 4 5 6 7 8 9 10 11TIMES THE GOAL WAS REACHED

AUDITORY STIMULI ONLY (7 subjects grand average)

y = -23,97x + 426,44 r2=0.68

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13 14TIMES THE GOAL WAS REACHED

learning was much faster for compound stimuli (slope= -31.8) than only auditory (slope= -23.0) or only visual (slope= -13.3) stimuli. The compound versus simple percept discrepancy was predicted by the model.

WG3 COST B27 MK national report, Istanbul, September 3. 2005

VISUAL AND AUDITORY STIMULI

VISUAL AND AUDITORY STIMULI(8 subjects grand average)

y = -31,777x + 488,74 r2=0.84

0

200

400

600

1 2 3 4 5 6 7 8 9 10 11 12 13TIMES THE GOAL WAS REACHED

WG3 COST B27 MK national report, Istanbul, September 3. 2005

TALK OUTLINE

PREVIOUS EXPERIENCE CNV and DCNV extraction and recognition EEG controlled devices

ONGOING RESEARCH representation of knowledge of the

environment in autonomous agents Behavior of human subjects in simple virtual

environments WG3 MK ROLE IN COST B27

WG3 COST B27 MK national report, Istanbul, September 3. 2005

EEG CONTROLED DEVICES

VISUAL FEEDBACK

RADIO CONTROL

WG3 COST B27 MK national report, Istanbul, September 3. 2005

SELECTED PUBLICATIONSStojanov, G., Bozinovski, S., Bozinovska, L., “AV Control System Which Makes Use of Environment Stabilizations”, SPIE Conference on Mobile Robot and Automated Vehicle Control, Boston, 1996.Stojanov, G., Bozinovska, L, Bozinovski, S., “Optimal Linear

Estimator for CNV Wave During the Dynamic CNV Paradigm Experiments”, 11th ISBE, Zagreb, 1996a.Bozinovska, L., Sestakov, M. Stojanov, G., Bozinovski, S.,

“Change in the CNV wave Intensity during bio-feedback Training with Personal Computer”, (in Serbo-Croatian),

Neurologija, Supl.2., 1988.Sestakov, M, “Digital Processing of Preparatory and Evoked Bio-

electric Sygnals” (in Macedonian), M.Sc. Thesis, ETF, University in Skopje, 1988Bozinovska, L., Bozinovski, S., Stojanov, G., “Electroexpectogram: Experimental Design and Algortithms”, IEEE Biomedical Days, Istambul, 1992.

WG3 COST B27 MK national report, Istanbul, September 3. 2005

TALK OUTLINE

PREVIOUS EXPERIENCE CNV and DCNV extraction and recognition EEG controlled devices

ONGOING RESEARCH representation of knowledge of the

environment in autonomous agents Behavior of human subjects in simple virtual

environments WG3 ROLE IN COST B27

WG3 COST B27 MK national report, Istanbul, September 3. 2005

WG3 ROLE IN COST B27

• participation in devising new experimental set-ups meant to invoke particular perceptual, memory/learning processes in human subjects; • participation in adaptation and development of new algorithms for EEG FTS patterns analysis; • development of a generic computational model of a system which comprises multitude of mutually affecting oscillators (in collaboration with WG1), and • modelling the observed phenomena