Intonation: buildings and bricks Francesco Cangemi Universitt
Zrich & Universitt zu Kln [email protected]
Slide 3
I. Theory 09:30 10:45 A. Architectures 1. Prosody and
intonation 2. Abstractionist assumptions 3. Exemplarist challenges
4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in
Italian 2. Intonational meaning 3. Challenging primitives i.
Contour warping ii. Individual behaviour II. Practice 14:00 15:00
C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis
(one example) ii. Analysis (many items)
Slide 4
I. Theory 09:30 10:45 A. Architectures 1. Prosody and
intonation 2. Abstractionist assumptions 3. Exemplarist challenges
4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in
Italian 2. Intonational meaning 3. Challenging primitives i.
Contour warping ii. Individual behaviour II. Practice 14:00 15:00
C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis
(one example) ii. Analysis (many items)
Slide 5
LongShort A B Prosody and arbitrariness 4 Both highly universal
and language-specific Physio- and psychologically motivated
Acquisition Learning Pathology PhylogeniesOntogenesis
FirstLast
Slide 6
5 hier soir, avant de s'endormir, Franois fumait une dernire
cigarette, en relisant le cours d'allemand qu'il avait prpar pour
ses lves de terminale. Puis, il crasa sa gauloise dans un cendrier,
et teignit la lumire. Un moment plus tard, une odeur de brl le
rveilla. La pice tait envahie de fume, et Franois s'aperut avec
effroi que les rideaux de la fentre avaient pris feu. [Louis et
alii, 2001] First to appear Last to disappear PROSODY The workmen
from Boston were leaving LearningPathology
Slide 7
Prosody and function 6 Message encoding and decoding
Disambiguation of (surface) syntactic structures PROSODY (Ill move
on) (Saturday) (Ill move) (on Saturday)
Slide 8
7 PROSODY Lexical access [Christophe et alii 2004] Le livre
racontait lhistoire [dun grand chat grincheux] [qui avait mordu un
facteur]CHAGRIN [dun grand chat drogu] [qui dormait tout le
temps]*CHAD Message encoding and decoding Disambiguation of
(surface) syntactic structures
Slide 9
8 PROSODY Information structure Management of interaction e.g.
backchannels [Benus et alii 2007] E.g., it.:Michele viene con me
Micheal comes with me Modality Contrastivity Givenness Lexical
access Message encoding and decoding Disambiguation of (surface)
syntactic structures
Slide 10
I. Theory 09:30 10:45 A. Architectures 1. Prosody and
intonation 2. Abstractionist assumptions 3. Exemplarist challenges
4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in
Italian 2. Intonational meaning 3. Challenging primitives i.
Contour warping ii. Individual behaviour II. Practice 14:00 15:00
C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis
(one example) ii. Analysis (many items)
Slide 11
Architectures 10 SUBSTANCE FUNCTION FORM Syntax Lexicon
Information structure Interaction f0 amplitude duration voice
quality
Slide 12
Architectures 11 SUBSTANCE FUNCTION FORM/kt/
Slide 13
Architectures (intonation) 12 Intonation refers to the use of
suprasegmental phonetic features to convey post-lexical or
sentence-level pragmatic meanings in a linguistically structured
way. [Ladd, 1996] FORM FUNCTION SUBSTANCE
Slide 14
Architectures (prosody) (Prosody is a) branch of linguistics
devoted to the factual description (phonetic aspects) and the
formal analysis (phonological aspects) of the systematic elements
in the phonic expression which are not coextensive to phonemes,
such as accents, tones, intonation and quantity. whose actual
manifestations in speech production are associated with variations
in the physical parameters of f0, duration and intensity, which
represent prosodys objective parameters. These variations are
perceived by the listener as changes in pitch, length and loudness,
which are prosodys subjective parameters. The prosodic elements
play at (lexical prosody) or above (post-lexical prosody) the word
level a bundle of grammatical, para-grammatical and
extra-grammatical functions, related to what is said, how it is
said and to speaker identity. These functions prove crucial in
signalling the structure of utterances and of discourse, and in
guiding their semantic and pragmatic interpretation. [Di Cristo
2004] 13 FORM FUNCTION SUBSTANCE
Slide 15
I. Theory 09:30 10:45 A. Architectures 1. Prosody and
intonation 2. Abstractionist assumptions 3. Exemplarist challenges
4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in
Italian 2. Intonational meaning 3. Challenging primitives i.
Contour warping ii. Individual behaviour II. Practice 14:00 15:00
C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis
(one example) ii. Analysis (many items)
Slide 16
An alternative architecture these models introduce a
phonological level of description that is intermediate between
(abstract) function and (concrete) phonetic form it is our
experience that one always get better results if one can do without
such an intermediate level, i.e., if one can establish a direct
link between (syntactic/semantic) function and phonetic form the
unfortunate notion of pitch accent [Batliner and Mbius 2005]
15
Slide 17
An alternative architecture substancefunction FORM exemplar
auditory properties f0,F1,F2,F3,dur category labels
word,sex,speaker [Johnson 1997] [K. Schweitzer 2012] 16
Slide 18
Categorization Monothetic approach (classical view) Singly
necessary and jointly sufficient features bug /b g/ bun /b n/
17
Slide 19
Prototypic (probabilistic view) Categories center around
members sharing many features Polythetic (Familienhnlichkeit)
elements of a class share more or less features 18
Slide 20
Episodic (exemplar view) Online categories, comparing probe to
stored exemplars A B C 19
Slide 21
I. Theory 09:30 10:45 A. Architectures 1. Prosody and
intonation 2. Abstractionist assumptions 3. Exemplarist challenges
4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in
Italian 2. Intonational meaning 3. Challenging primitives i.
Contour warping ii. Individual behaviour II. Practice 14:00 15:00
C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis
(one example) ii. Analysis (many items)
Slide 22
Phonetic detail Exemplar-based models: Traces for words are
stored without reducing phonetic information to an abstract
phonological representation Phonetic detail: systematically
produced and perceived phonetic information which is not included
in abstract phonological representations 21
Slide 23
True prefix:discolour/ ds kl/ Pseudo-prefix:discover/ ds kv/
Spectrotemporal patterns [R. Smith et al. 2012] Production
Intelligibility in noise [Baker et al. 2007] Perception Frequency
[Bybee 2001] mammary[mmi] artillery[tli] memory[mm i] every[v.i]
22
Slide 24
Exemplar-based models: Traces for words are stored without
reducing phonetic information to an abstract phonological
representation + Functional approaches to prosody: No intermediate
phonological level, but only a direct link between function and
phonetics = Exemplar-based prosody: Words are stored along with
their f0 contours 23 Exemplar prosody set of category labels set of
auditory properties exemplar [K. Schweitzer 2012]
Slide 25
Words are stored along with their f0 contour Memory
requirements Feature analysis A:I hear youll soon be a doctor in
chemistry. B:a.Me?!b.A doctor in chemistry?! H L H Adapted from
[Ladd 1996] Restrictive view of phonetic detail: systematically
produced and perceived phonetic information which is not YET
included in abstract phonological representations 24
Slide 26
Abstract forms (e.g. pitch accents) in AM theory are
phonetically very underspecified PROSODIC CUES f0 duration
amplitude spectral features events interpolations 25 Prosodic
detail If systematically produced and perceived phonetic
information is found to cue functional contrasts, phonological
representations might be enriched either in inventory or
grammar
Slide 27
I. Theory 09:30 10:45 A. Architectures 1. Prosody and
intonation 2. Abstractionist assumptions 3. Exemplarist challenges
4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in
Italian 2. Intonational meaning 3. Challenging primitives i.
Contour warping ii. Individual behaviour II. Practice 14:00 15:00
C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis
(one example) ii. Analysis (many items)
Slide 28
PROSODIC CUES f0 duration amplitude spectral features events
interpolations 27 Partial Topic constructions seem to have
distinctive rise shape Interpolation rather than events?!
Slide 29
28 Narrowing down the Discourse Topic Non exhaustive answer
[Bring 1997] Partial Topics in Neapolitan Italian A: How do your
friends like their coffee? B: Milena drinks it black (as for the
others, I wouldnt know) milenalovuoleamaro
milenait-OBJwant-3SGunsweetened
Slide 30
Alignment Scaling Curve index: [Dombrowski & Niebuhr 2005;
Cangemi 2009] 29 Reading task with contextualizing paragraph 3
sentences 2 contexts 7 speakers 5 repetitions 210 items Two-sample
two-tailed T-tests Both with prosodic break after N L is
acceleration peak (d)
Slide 31
C scaling Curve index L H start ofend of ScalingAlignment
p
Some results Production - acoustics SpeakerAHDMHNMBWP Peak
alignment broad * narrow * contrast broad * narrow/contrast broad *
narrow * contrast Peak height broad * narrow * contrast broad *
narrow/contrast broad * narrow * contrast Duration of target word
broad/narrow * contrast broad/narrow * contrast broad * narrow *
contrast broad * contrast broad * narrow * contrast Number of
prenclear accents broad/narrow * contrast broad * narrow/contrast
broad/narrow * contrast Duration of first word broad * contrast
broad * narrow/contrast Expectations towards perception? AH > HN
> DM > WP > MB ?
Slide 71
Some results Production - articulation Mcke and Grice,
forthcoming
Slide 72
Some results Perception across listeners, BB>...>KS2 ~30%
across speakers, AH>DM>HN>WP>MB ~10%
Slide 73
Some results Interactions Similarly significant results with
mixed models, using intercepts and slopes for speaker-listener
dyads (thanks Roger Mundry and SSSPP summerschool!) Logit linear
model predicting correct answers (contrastive), Speaker and
Listener as fixed factors Significantly different from model
including interactions Pr(Chi) = 0.002 **
Slide 74
New questions Method: Listeners also performing reading task?
(do they use strategies which are similar to those of the speakers
they rated more consistently?) Speakers also performing the
identification task (do they identify more reliably the productions
of speakers which use strategies similar to their own?) and if yes:
should they also rate themselves?!
Slide 75
New questions Assumptions: Can we really postulate that some
speakers or listeners are more performative than others? universal
donor and universal recipient Does this conflict with viewing
similarity of production as an advantage for perception? Empedocles
like is known by like Implications: From speaker/listener specific
behaviour through speker/listener group behaviour to sound change?
with listener-speaker mismatch? (Ohala, 1981) Back