74
Intonation: buildings and bricks Francesco Cangemi Universität Zürich & Universität zu Köln [email protected]

Intonation: buildings and bricks Francesco Cangemi Universität Zürich & Universität zu Köln [email protected]

Embed Size (px)

Citation preview

  • Slide 1
  • Slide 2
  • Intonation: buildings and bricks Francesco Cangemi Universitt Zrich & Universitt zu Kln [email protected]
  • Slide 3
  • I. Theory 09:30 10:45 A. Architectures 1. Prosody and intonation 2. Abstractionist assumptions 3. Exemplarist challenges 4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in Italian 2. Intonational meaning 3. Challenging primitives i. Contour warping ii. Individual behaviour II. Practice 14:00 15:00 C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis (one example) ii. Analysis (many items)
  • Slide 4
  • I. Theory 09:30 10:45 A. Architectures 1. Prosody and intonation 2. Abstractionist assumptions 3. Exemplarist challenges 4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in Italian 2. Intonational meaning 3. Challenging primitives i. Contour warping ii. Individual behaviour II. Practice 14:00 15:00 C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis (one example) ii. Analysis (many items)
  • Slide 5
  • LongShort A B Prosody and arbitrariness 4 Both highly universal and language-specific Physio- and psychologically motivated Acquisition Learning Pathology PhylogeniesOntogenesis FirstLast
  • Slide 6
  • 5 hier soir, avant de s'endormir, Franois fumait une dernire cigarette, en relisant le cours d'allemand qu'il avait prpar pour ses lves de terminale. Puis, il crasa sa gauloise dans un cendrier, et teignit la lumire. Un moment plus tard, une odeur de brl le rveilla. La pice tait envahie de fume, et Franois s'aperut avec effroi que les rideaux de la fentre avaient pris feu. [Louis et alii, 2001] First to appear Last to disappear PROSODY The workmen from Boston were leaving LearningPathology
  • Slide 7
  • Prosody and function 6 Message encoding and decoding Disambiguation of (surface) syntactic structures PROSODY (Ill move on) (Saturday) (Ill move) (on Saturday)
  • Slide 8
  • 7 PROSODY Lexical access [Christophe et alii 2004] Le livre racontait lhistoire [dun grand chat grincheux] [qui avait mordu un facteur]CHAGRIN [dun grand chat drogu] [qui dormait tout le temps]*CHAD Message encoding and decoding Disambiguation of (surface) syntactic structures
  • Slide 9
  • 8 PROSODY Information structure Management of interaction e.g. backchannels [Benus et alii 2007] E.g., it.:Michele viene con me Micheal comes with me Modality Contrastivity Givenness Lexical access Message encoding and decoding Disambiguation of (surface) syntactic structures
  • Slide 10
  • I. Theory 09:30 10:45 A. Architectures 1. Prosody and intonation 2. Abstractionist assumptions 3. Exemplarist challenges 4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in Italian 2. Intonational meaning 3. Challenging primitives i. Contour warping ii. Individual behaviour II. Practice 14:00 15:00 C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis (one example) ii. Analysis (many items)
  • Slide 11
  • Architectures 10 SUBSTANCE FUNCTION FORM Syntax Lexicon Information structure Interaction f0 amplitude duration voice quality
  • Slide 12
  • Architectures 11 SUBSTANCE FUNCTION FORM/kt/
  • Slide 13
  • Architectures (intonation) 12 Intonation refers to the use of suprasegmental phonetic features to convey post-lexical or sentence-level pragmatic meanings in a linguistically structured way. [Ladd, 1996] FORM FUNCTION SUBSTANCE
  • Slide 14
  • Architectures (prosody) (Prosody is a) branch of linguistics devoted to the factual description (phonetic aspects) and the formal analysis (phonological aspects) of the systematic elements in the phonic expression which are not coextensive to phonemes, such as accents, tones, intonation and quantity. whose actual manifestations in speech production are associated with variations in the physical parameters of f0, duration and intensity, which represent prosodys objective parameters. These variations are perceived by the listener as changes in pitch, length and loudness, which are prosodys subjective parameters. The prosodic elements play at (lexical prosody) or above (post-lexical prosody) the word level a bundle of grammatical, para-grammatical and extra-grammatical functions, related to what is said, how it is said and to speaker identity. These functions prove crucial in signalling the structure of utterances and of discourse, and in guiding their semantic and pragmatic interpretation. [Di Cristo 2004] 13 FORM FUNCTION SUBSTANCE
  • Slide 15
  • I. Theory 09:30 10:45 A. Architectures 1. Prosody and intonation 2. Abstractionist assumptions 3. Exemplarist challenges 4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in Italian 2. Intonational meaning 3. Challenging primitives i. Contour warping ii. Individual behaviour II. Practice 14:00 15:00 C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis (one example) ii. Analysis (many items)
  • Slide 16
  • An alternative architecture these models introduce a phonological level of description that is intermediate between (abstract) function and (concrete) phonetic form it is our experience that one always get better results if one can do without such an intermediate level, i.e., if one can establish a direct link between (syntactic/semantic) function and phonetic form the unfortunate notion of pitch accent [Batliner and Mbius 2005] 15
  • Slide 17
  • An alternative architecture substancefunction FORM exemplar auditory properties f0,F1,F2,F3,dur category labels word,sex,speaker [Johnson 1997] [K. Schweitzer 2012] 16
  • Slide 18
  • Categorization Monothetic approach (classical view) Singly necessary and jointly sufficient features bug /b g/ bun /b n/ 17
  • Slide 19
  • Prototypic (probabilistic view) Categories center around members sharing many features Polythetic (Familienhnlichkeit) elements of a class share more or less features 18
  • Slide 20
  • Episodic (exemplar view) Online categories, comparing probe to stored exemplars A B C 19
  • Slide 21
  • I. Theory 09:30 10:45 A. Architectures 1. Prosody and intonation 2. Abstractionist assumptions 3. Exemplarist challenges 4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in Italian 2. Intonational meaning 3. Challenging primitives i. Contour warping ii. Individual behaviour II. Practice 14:00 15:00 C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis (one example) ii. Analysis (many items)
  • Slide 22
  • Phonetic detail Exemplar-based models: Traces for words are stored without reducing phonetic information to an abstract phonological representation Phonetic detail: systematically produced and perceived phonetic information which is not included in abstract phonological representations 21
  • Slide 23
  • True prefix:discolour/ ds kl/ Pseudo-prefix:discover/ ds kv/ Spectrotemporal patterns [R. Smith et al. 2012] Production Intelligibility in noise [Baker et al. 2007] Perception Frequency [Bybee 2001] mammary[mmi] artillery[tli] memory[mm i] every[v.i] 22
  • Slide 24
  • Exemplar-based models: Traces for words are stored without reducing phonetic information to an abstract phonological representation + Functional approaches to prosody: No intermediate phonological level, but only a direct link between function and phonetics = Exemplar-based prosody: Words are stored along with their f0 contours 23 Exemplar prosody set of category labels set of auditory properties exemplar [K. Schweitzer 2012]
  • Slide 25
  • Words are stored along with their f0 contour Memory requirements Feature analysis A:I hear youll soon be a doctor in chemistry. B:a.Me?!b.A doctor in chemistry?! H L H Adapted from [Ladd 1996] Restrictive view of phonetic detail: systematically produced and perceived phonetic information which is not YET included in abstract phonological representations 24
  • Slide 26
  • Abstract forms (e.g. pitch accents) in AM theory are phonetically very underspecified PROSODIC CUES f0 duration amplitude spectral features events interpolations 25 Prosodic detail If systematically produced and perceived phonetic information is found to cue functional contrasts, phonological representations might be enriched either in inventory or grammar
  • Slide 27
  • I. Theory 09:30 10:45 A. Architectures 1. Prosody and intonation 2. Abstractionist assumptions 3. Exemplarist challenges 4. Prosodic detail 11:00 12:30 B. Primitives 1. Partial Topics in Italian 2. Intonational meaning 3. Challenging primitives i. Contour warping ii. Individual behaviour II. Practice 14:00 15:00 C. Praat scripting 1. Basics 15:15 16:30 2. Plotting i. Synthesis (one example) ii. Analysis (many items)
  • Slide 28
  • PROSODIC CUES f0 duration amplitude spectral features events interpolations 27 Partial Topic constructions seem to have distinctive rise shape Interpolation rather than events?!
  • Slide 29
  • 28 Narrowing down the Discourse Topic Non exhaustive answer [Bring 1997] Partial Topics in Neapolitan Italian A: How do your friends like their coffee? B: Milena drinks it black (as for the others, I wouldnt know) milenalovuoleamaro milenait-OBJwant-3SGunsweetened
  • Slide 30
  • Alignment Scaling Curve index: [Dombrowski & Niebuhr 2005; Cangemi 2009] 29 Reading task with contextualizing paragraph 3 sentences 2 contexts 7 speakers 5 repetitions 210 items Two-sample two-tailed T-tests Both with prosodic break after N L is acceleration peak (d)
  • Slide 31
  • C scaling Curve index L H start ofend of ScalingAlignment p
  • Some results Production - acoustics SpeakerAHDMHNMBWP Peak alignment broad * narrow * contrast broad * narrow/contrast broad * narrow * contrast Peak height broad * narrow * contrast broad * narrow/contrast broad * narrow * contrast Duration of target word broad/narrow * contrast broad/narrow * contrast broad * narrow * contrast broad * contrast broad * narrow * contrast Number of prenclear accents broad/narrow * contrast broad * narrow/contrast broad/narrow * contrast Duration of first word broad * contrast broad * narrow/contrast Expectations towards perception? AH > HN > DM > WP > MB ?
  • Slide 71
  • Some results Production - articulation Mcke and Grice, forthcoming
  • Slide 72
  • Some results Perception across listeners, BB>...>KS2 ~30% across speakers, AH>DM>HN>WP>MB ~10%
  • Slide 73
  • Some results Interactions Similarly significant results with mixed models, using intercepts and slopes for speaker-listener dyads (thanks Roger Mundry and SSSPP summerschool!) Logit linear model predicting correct answers (contrastive), Speaker and Listener as fixed factors Significantly different from model including interactions Pr(Chi) = 0.002 **
  • Slide 74
  • New questions Method: Listeners also performing reading task? (do they use strategies which are similar to those of the speakers they rated more consistently?) Speakers also performing the identification task (do they identify more reliably the productions of speakers which use strategies similar to their own?) and if yes: should they also rate themselves?!
  • Slide 75
  • New questions Assumptions: Can we really postulate that some speakers or listeners are more performative than others? universal donor and universal recipient Does this conflict with viewing similarity of production as an advantage for perception? Empedocles like is known by like Implications: From speaker/listener specific behaviour through speker/listener group behaviour to sound change? with listener-speaker mismatch? (Ohala, 1981) Back