11
Perception of Temporal Perception of Temporal Patterns Patterns Dirk-Jan Povel & Peter Essens Dirk-Jan Povel & Peter Essens University of Nijmegen, The University of Nijmegen, The Netherlands Netherlands

Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

  • View
    212

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Perception of Temporal PatternsPerception of Temporal Patterns

Dirk-Jan Povel & Peter EssensDirk-Jan Povel & Peter EssensUniversity of Nijmegen, The NetherlandsUniversity of Nijmegen, The Netherlands

Page 2: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

OverviewOverview

Nature of Temporal PatternsNature of Temporal Patterns

The ModelThe Model

ExperimentsExperiments Experiment 1 – PredictionExperiment 1 – Prediction Experiment 2 – Internal Clock Experiment 2 – Internal Clock Experiment 3 – Double SequencesExperiment 3 – Double Sequences

Conclusion and Future WorkConclusion and Future Work

Perception of Temporal Patterns 2/11

Page 3: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Comprise a special class of serial patternsComprise a special class of serial patterns-Collard & Povel, 1982-Collard & Povel, 1982

-Deutsch & Feroe, 1981-Deutsch & Feroe, 1981

-Leeuwenberg, 1969-Leeuwenberg, 1969

-Restle, 1970-Restle, 1970

-Simon, 1972-Simon, 1972

Symmetry is not perceivedSymmetry is not perceived-Mach, 1886-Mach, 1886

-Restle, 1976-Restle, 1976

Do not form alphabetsDo not form alphabets-Coding models using in serial patterns can’t use in temporal patterns-Coding models using in serial patterns can’t use in temporal patterns

Special Nature of Temporal PatternsSpecial Nature of Temporal Patterns

Perception of Temporal Patterns 3/11

Page 4: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

The ModelThe Model

Internal ClockInternal Clock Absolute clockAbsolute clock Unit derived from the sequenceUnit derived from the sequence Hierarchical clockHierarchical clock

Unit (interval between ticks)Unit (interval between ticks)

Location (synchronization)Location (synchronization)

One periodPattern

ClocksUnit Location 2 1

2 2

3 1

4 3

Perception of Temporal Patterns 4/11

Page 5: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

AccentAccent Isolated tonesIsolated tones The second tone of a cluster of two tonesThe second tone of a cluster of two tones The initial and final tones of a three or more tones clusterThe initial and final tones of a three or more tones cluster

The Model (cont.)The Model (cont.)

one period

< < < < < <

Sequence 1 1 1 2 1 3 2 1 4 :

Perception of Temporal Patterns 5/11

Selection of clocks

Page 6: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

The Model (cont.)The Model (cont.)Best ClockBest Clock

C: amount of counterevidenceC: amount of counterevidenceev: accented event, 0ev: unaccented event, -ev: silent eventev: accented event, 0ev: unaccented event, -ev: silent event

C = (W* -ev) + (1* 0ev)C = (W* -ev) + (1* 0ev)

Sets of patternsSets of patterns

Categories 1:Categories 1:

Categories Categories 2,3,4:2,3,4:

Categories Categories 5,6,7: 5,6,7:

Categories 9:Categories 9:

<< < < < <

Combination of 1 1 1 1 2 3 3 4:

1 1 2 3 1 3 1 4

< < < < < <

1 2 1 1 3 3 1 4 (C3)

< < < < < < <

< < < < < <

3 1 1 2 3 1 1 4 (C7)

1 1 1 3 1 2 3 4

Perception of Temporal Patterns 6/11

Page 7: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Coding the temporal structureCoding the temporal structure S : If clock unit is subdivided into equal intervalsS : If clock unit is subdivided into equal intervals E : If clock unit is emptyE : If clock unit is empty N - N : If clock unit is subdivided in unequal lengthN - N : If clock unit is subdivided in unequal length

The Model (cont.)The Model (cont.)

Example: Pattern 1 1 2 2 1 1 1 1 2

ClockUnit Location

4 3

2 1

Code

S2, S4, 2-1-1

S2, E, E, S2, S2, E

Perception of Temporal Patterns 7/11

Page 8: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Experiment 1Experiment 135 sequences from the combination 1 1 1 1 1 2 2 3 435 sequences from the combination 1 1 1 1 1 2 2 3 4

(5 from each of seven categories)(5 from each of seven categories)

Reproduce these sequence by 24 subjectsReproduce these sequence by 24 subjects

0

50

100

150

200

250

300

350

1 2 3 4 5 6 7

Category

Me

an

De

via

tio

n (

ms

ec

)

skilled

all subjects

unskilled

*Higher categories will have worse reproduction

**Strength of induction plays a crucial role

Perception of Temporal Patterns 8/11

Page 9: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Experiment 2Experiment 220 sequences and same subjects from the previous experiment20 sequences and same subjects from the previous experiment

Reproduce the sequence after hearing a patterned sequence Reproduce the sequence after hearing a patterned sequence

830 Hz

125 Hz125 Hz

0

50

100

150

200

250

1 2 3 4

Category

Me

an

De

via

tio

n (

ms

ec

)

Expt.2

Expt.1

**The reproduction improves with the additional induction of an internal clock

Perception of Temporal Patterns 9/11

Page 10: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Experiment 3Experiment 312 pairs of two double sequences12 pairs of two double sequences

Compare each pair of sequences by 25 subjectsCompare each pair of sequences by 25 subjects

3 - clock 4 - clock

Perception of Temporal Patterns 10/11

0

10

20

30

40

50

60

70

80

90

100

1 2 3 4 5 6 7 8 9 10 11 12

Ch

oic

e fo

r 4-

Clo

ck (

%)

**temporal structure is coded in units of the clock

Sequence Nonreducible Intervals (3-clock) (4-clock)3 1 2 2 1 1 1 1 2 13 1 1 1 2 1 3 1 3…

Page 11: Perception of Temporal Patterns Dirk-Jan Povel & Peter Essens University of Nijmegen, The Netherlands

Conclusion and Future WorkConclusion and Future Work

A given temporal pattern will be poorly reproduced A given temporal pattern will be poorly reproduced (Expt.1, Expt.2) or be judged (Expt.3) when either no (Expt.1, Expt.2) or be judged (Expt.3) when either no internal clock is induced or the coding is complex. internal clock is induced or the coding is complex.

The internal representation of a pattern completely The internal representation of a pattern completely depends on the clock which is internally induced. depends on the clock which is internally induced.

Clock-selection mechanismClock-selection mechanism

Further analyze in coding characteristicsFurther analyze in coding characteristics

Determine the contribution of decoding in the production Determine the contribution of decoding in the production of temporal patternsof temporal patterns

Perception of Temporal Patterns 11/11