View
212
Download
0
Embed Size (px)
Citation preview
Perception of Temporal PatternsPerception of Temporal Patterns
Dirk-Jan Povel & Peter EssensDirk-Jan Povel & Peter EssensUniversity of Nijmegen, The NetherlandsUniversity of Nijmegen, The Netherlands
OverviewOverview
Nature of Temporal PatternsNature of Temporal Patterns
The ModelThe Model
ExperimentsExperiments Experiment 1 – PredictionExperiment 1 – Prediction Experiment 2 – Internal Clock Experiment 2 – Internal Clock Experiment 3 – Double SequencesExperiment 3 – Double Sequences
Conclusion and Future WorkConclusion and Future Work
Perception of Temporal Patterns 2/11
Comprise a special class of serial patternsComprise a special class of serial patterns-Collard & Povel, 1982-Collard & Povel, 1982
-Deutsch & Feroe, 1981-Deutsch & Feroe, 1981
-Leeuwenberg, 1969-Leeuwenberg, 1969
-Restle, 1970-Restle, 1970
-Simon, 1972-Simon, 1972
Symmetry is not perceivedSymmetry is not perceived-Mach, 1886-Mach, 1886
-Restle, 1976-Restle, 1976
Do not form alphabetsDo not form alphabets-Coding models using in serial patterns can’t use in temporal patterns-Coding models using in serial patterns can’t use in temporal patterns
Special Nature of Temporal PatternsSpecial Nature of Temporal Patterns
Perception of Temporal Patterns 3/11
The ModelThe Model
Internal ClockInternal Clock Absolute clockAbsolute clock Unit derived from the sequenceUnit derived from the sequence Hierarchical clockHierarchical clock
Unit (interval between ticks)Unit (interval between ticks)
Location (synchronization)Location (synchronization)
One periodPattern
ClocksUnit Location 2 1
2 2
3 1
4 3
Perception of Temporal Patterns 4/11
AccentAccent Isolated tonesIsolated tones The second tone of a cluster of two tonesThe second tone of a cluster of two tones The initial and final tones of a three or more tones clusterThe initial and final tones of a three or more tones cluster
The Model (cont.)The Model (cont.)
one period
< < < < < <
Sequence 1 1 1 2 1 3 2 1 4 :
Perception of Temporal Patterns 5/11
Selection of clocks
The Model (cont.)The Model (cont.)Best ClockBest Clock
C: amount of counterevidenceC: amount of counterevidenceev: accented event, 0ev: unaccented event, -ev: silent eventev: accented event, 0ev: unaccented event, -ev: silent event
C = (W* -ev) + (1* 0ev)C = (W* -ev) + (1* 0ev)
Sets of patternsSets of patterns
Categories 1:Categories 1:
Categories Categories 2,3,4:2,3,4:
Categories Categories 5,6,7: 5,6,7:
Categories 9:Categories 9:
<< < < < <
Combination of 1 1 1 1 2 3 3 4:
1 1 2 3 1 3 1 4
< < < < < <
1 2 1 1 3 3 1 4 (C3)
< < < < < < <
< < < < < <
3 1 1 2 3 1 1 4 (C7)
1 1 1 3 1 2 3 4
Perception of Temporal Patterns 6/11
Coding the temporal structureCoding the temporal structure S : If clock unit is subdivided into equal intervalsS : If clock unit is subdivided into equal intervals E : If clock unit is emptyE : If clock unit is empty N - N : If clock unit is subdivided in unequal lengthN - N : If clock unit is subdivided in unequal length
The Model (cont.)The Model (cont.)
Example: Pattern 1 1 2 2 1 1 1 1 2
ClockUnit Location
4 3
2 1
Code
S2, S4, 2-1-1
S2, E, E, S2, S2, E
Perception of Temporal Patterns 7/11
Experiment 1Experiment 135 sequences from the combination 1 1 1 1 1 2 2 3 435 sequences from the combination 1 1 1 1 1 2 2 3 4
(5 from each of seven categories)(5 from each of seven categories)
Reproduce these sequence by 24 subjectsReproduce these sequence by 24 subjects
0
50
100
150
200
250
300
350
1 2 3 4 5 6 7
Category
Me
an
De
via
tio
n (
ms
ec
)
skilled
all subjects
unskilled
*Higher categories will have worse reproduction
**Strength of induction plays a crucial role
Perception of Temporal Patterns 8/11
Experiment 2Experiment 220 sequences and same subjects from the previous experiment20 sequences and same subjects from the previous experiment
Reproduce the sequence after hearing a patterned sequence Reproduce the sequence after hearing a patterned sequence
830 Hz
125 Hz125 Hz
0
50
100
150
200
250
1 2 3 4
Category
Me
an
De
via
tio
n (
ms
ec
)
Expt.2
Expt.1
**The reproduction improves with the additional induction of an internal clock
Perception of Temporal Patterns 9/11
Experiment 3Experiment 312 pairs of two double sequences12 pairs of two double sequences
Compare each pair of sequences by 25 subjectsCompare each pair of sequences by 25 subjects
3 - clock 4 - clock
Perception of Temporal Patterns 10/11
0
10
20
30
40
50
60
70
80
90
100
1 2 3 4 5 6 7 8 9 10 11 12
Ch
oic
e fo
r 4-
Clo
ck (
%)
**temporal structure is coded in units of the clock
Sequence Nonreducible Intervals (3-clock) (4-clock)3 1 2 2 1 1 1 1 2 13 1 1 1 2 1 3 1 3…
Conclusion and Future WorkConclusion and Future Work
A given temporal pattern will be poorly reproduced A given temporal pattern will be poorly reproduced (Expt.1, Expt.2) or be judged (Expt.3) when either no (Expt.1, Expt.2) or be judged (Expt.3) when either no internal clock is induced or the coding is complex. internal clock is induced or the coding is complex.
The internal representation of a pattern completely The internal representation of a pattern completely depends on the clock which is internally induced. depends on the clock which is internally induced.
Clock-selection mechanismClock-selection mechanism
Further analyze in coding characteristicsFurther analyze in coding characteristics
Determine the contribution of decoding in the production Determine the contribution of decoding in the production of temporal patternsof temporal patterns
Perception of Temporal Patterns 11/11