52
Intonational phonology in Bengali and English infant-directed speech Kristine M. Yu, University of Massachusetts Amherst Sameer ud Dowla Khan, Reed College Megha Sundara, University of California Los Angeles Speech Prosody 7, Trinity College Dublin Friday 23 May 2014 1

Intonational phonology in Bengali and English infant

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Intonational phonology in Bengali and English infant

IntonationalphonologyinBengaliandEnglishinfant-directedspeech

KristineM.Yu,UniversityofMassachusettsAmherstSameerudDowlaKhan,ReedCollegeMeghaSundara,UniversityofCaliforniaLosAngelesSpeechProsody7,TrinityCollegeDublinFriday23May2014

1

Page 2: Intonational phonology in Bengali and English infant

Hypothesis:affectandgrammar

¡  Howdowebuildtheintonationalcontourofanutterance?l  Grammaticalstructure?l  Socialcontext/affect?

¡  Prosodicchoicesareconditionedonboth¡  Howdoweknow?¡  Casestudy:Infant-directedspeechin

BengaliandEnglish

2

Page 3: Intonational phonology in Bengali and English infant

Infant-directedspeech(IDS):English

Adult-directedspeech

Infant-directedspeech

3

Page 4: Intonational phonology in Bengali and English infant

Infant-directedspeech(IDS):Bengali

Infant-directedspeech

Adult-directedspeech

4

Page 5: Intonational phonology in Bengali and English infant

Background

5

Page 6: Intonational phonology in Bengali and English infant

Infant-directedspeech(IDS)

¡  IDSprosodyistraditionallyanalyzedfromanacoustic-phoneticapproach1

l  Expansionoff0rangeviaraisingoff0maxl  Increaseinf0variability,e.g.sinusoidal,bell-shapedcontours

l  Exaggerationofcontours

¡  Thesemanipulationsmaintaininfantattention,elicitpositiveemotionalrapport2

1Jacobsonetal.1983,Sternetal.1983,Fernald&Simon1984,Fernaldetal.1989,Fernald&Mazzie1991,Greiser&Kuhl1998,Masataka19992Sternetal.1982 6

Page 7: Intonational phonology in Bengali and English infant

Grammaticalstructureinintonation

¡  Intonationisalsogrammaticallystructuredl  Finiteinventoryofdiscretetonalelementsl  Hierarchicalprosodicstructurel  Predictablevariationintones(allotones)l  Phonotacticgrammaroflicittonalsequencesl  Semantic/pragmaticmotivationforchoiceoftonalelements

7

Page 8: Intonational phonology in Bengali and English infant

Hierarchicalprosodicstructure

MainstreamAmericanEnglish

Page 9: Intonational phonology in Bengali and English infant

Hypothesis

¡  Attentional/emotionalcontextandgrammarjointlyconstrainf0modulationl  Prosodicchoiceswithinintonationalgrammarmotivatedbyattentional/emotionalcontext

l  Prosodicchoiceswithinattentional/emotionalcontextconstrainedbyintonationalgrammar

9

Page 10: Intonational phonology in Bengali and English infant

Attentional/emotionalmotivation

IncreaseintonalcategorieswithhighertargetsandmultipleturningpointsConstrainedbylg-specificgrammar

BengaliEnglish

10

Page 11: Intonational phonology in Bengali and English infant

Semantic/pragmaticmotivation

¡  Increaseintonalcategorieshighlightinginformationstructure

¡  Constrainedbylg-specificgrammarl  Bengali:5pitchaccents

L*(low) H*(high) fH*(super-H+compression)L*+H(rising) L*+fH(super-Hrising+cmp)

l  Bengali:5boundarytonesL%(lowfall) H%(highrise)LH%(lowrise) HL%(highfall) HLH%(highfall-rise)

11

Page 12: Intonational phonology in Bengali and English infant

Semantic/pragmaticmotivation

Thesemarkfocus

¡  Increaseintonalcategorieshighlightinginformationstructure

¡  Constrainedbylg-specificgrammarl  Bengali:5pitchaccents

L*(low) H*(high) fH*(super-H+compression)L*+H(rising) L*+fH(super-Hrising+cmp)

l  Bengali:5boundarytonesL%(lowfall) H%(highrise)LH%(lowrise) HL%(highfall) HLH%(highfall-rise)

12

Page 13: Intonational phonology in Bengali and English infant

Semantic/pragmaticmotivation

Thesemarktopics

¡  Increaseintonalcategorieshighlightinginformationstructure

¡  Constrainedbylg-specificgrammarl  Bengali:5pitchaccents

L*(low) H*(high) fH*(super-H+compression)L*+H(rising) L*+fH(super-Hrising+cmp)

l  Bengali:5boundarytonesL%(lowfall) H%(highrise)LH%(lowrise) HL%(highfall) HLH%(highfall-rise)

13

Page 14: Intonational phonology in Bengali and English infant

Semantic/pragmaticmotivation

¡  Increaseintonalcategorieshighlightinginformationstructure

¡  Constrainedbylg-specificgrammarl  Bengali:5pitchaccents

L*(low) H*(high) fH*(super-H+compression)L*+H(rising) L*+fH(super-Hrising+cmp)

l  Bengali:5boundarytonesL%(lowfall) H%(highrise)LH%(lowrise) HL%(highfall) HLH%(highfall-rise)

Thesearecontinuationrises 14

Page 15: Intonational phonology in Bengali and English infant

Experimentaldesign

15

Page 16: Intonational phonology in Bengali and English infant

Design:subjects

¡  20subjectsl  10speakersofEnglish(5M,5F)l  10speakersofBengali(5M,5F)

¡  Allwereparentsl  English:parentsof4.5-mo-oldsl  Bengali:parentsofyoungchildren

16

Page 17: Intonational phonology in Bengali and English infant

Design:materials

¡  Recorded“NorthWindandSun”fablel  SuitableforadultspeechandIDSl  Similarsemantics/pragmaticsacrosslanguagesl  Consistentsemantics,morphosyntax,segmentalphonologyacrossstyles

l  Usedinstudiesofspeechrhythm&prosody

17

Page 18: Intonational phonology in Bengali and English infant

Design:styles

¡  Twostylesl  Defaultreading(non-IDS):“Readatacomfortablepace.”

l  Simulatedinfant-directedreading(IDS):“Readasifspeakingtoyour4-mo-oldchild.”

¡  Sametext,illustratedwithchildlikedrawings¡  Stuffedanimalsarrangedaroundspeaker

18

Page 19: Intonational phonology in Bengali and English infant

Experiment:annotation

¡  EnglishMAE_ToBI1annotationl  2transcriberswithoutknowledgeofstudy

¡  BengaliB-ToBI2annotationl  1transcribersofar(2ndauthor)

1Beckmanetal.20052Khan2008,2014 19

Page 20: Intonational phonology in Bengali and English infant

Analysis

¡  Acoustic-phoneticmeasurementsl  f0min,max,range,standarddeviation

¡  Phonologicaldatacollectionl  Inventoryoftonesl  Numberofpitchaccentsandboundarytonesl  Frequencyofdifferenttonalcategories

¡  Statisticsl  Mixedeffectslogisticandpoissonregression

20

Page 21: Intonational phonology in Bengali and English infant

Results

21

Page 22: Intonational phonology in Bengali and English infant

Previewofresults

¡  What’sthesameacrossstyles:1)  Foreachlg.,IDSandnon-IDScanbothbe

analyzedusingthesameprosodicmodel

¡  Whatdiffersacrossstyles:2)  IDShaswiderpitchrange(highermax)3)  IDShasahigherproportionofcertaintones4)  IDShasmoreIPs5)  IDShasmorecomplextones

expected

we’llcomebacktothisinthediscussion

22

Page 23: Intonational phonology in Bengali and English infant

f01 f02 f03 f04 f05

m01 m02 m03 m04 m05

4.5

5.0

5.5

6.0

4.5

5.0

5.5

6.0

non−IDS ids non−IDS ids non−IDS ids non−IDS ids non−IDS idsstyle

log(

fund

amen

tal f

requ

ency

) (H

z)

stylenon−IDSids

2)Pitchrange

¡  AllBengalispeakersraisedthef0maxinIDS

¡  Higherf0variabilityinIDS

¡  SamepatternseeninEnglish

¡  Replicatespreviousstudies

¡  ValidationofsimulatedIDS

IDSnon-IDS

meanf095%f0range

5%f0range

23

Page 24: Intonational phonology in Bengali and English infant

PreviewofEnglish-specificresults

¡  EnglishIDSinvolves:l  IncreaseinL+H*pitchaccentl  IncreaseinIPs

24

Page 25: Intonational phonology in Bengali and English infant

3)English:pitchaccents

¡  NochangeinnumberofPAsbetweenstyles¡  Speakersincreasedthenumberand

proportionofL+H*inIDSl  non-IDS20.8%vs.IDS30.1%

25

Page 26: Intonational phonology in Bengali and English infant

f10 f11 f3 f8 f9

m1 m10 m4 m5 m6

0

50

100

150

200

0

50

100

150

200

non−ids ids non−ids ids non−ids ids non−ids ids non−ids idsStyle

Raw

freq

uenc

y

Pitch accents * H* H+!H* L* L*+H L+H*

Frequency of tones conditioned on speaker and style, T1

byspkr.

26

Page 27: Intonational phonology in Bengali and English infant

4)English:IPs

¡  Onaverage,Englishspeakersproduced33.3%(=3.44)moreIPsinIDS

27

Page 28: Intonational phonology in Bengali and English infant

byspkr.f10 f11 f3 f8 f9

m1 m10 m4 m5 m6

0

20

40

60

0

20

40

60

T1 T2 T1 T2 T1 T2 T1 T2 T1 T2Transcriber

Num

ber o

f IP

tone

s

Style non−ids ids

28

Page 29: Intonational phonology in Bengali and English infant

4)English:IPs

L-H% L-L% L-L%

L-L%

] ] ]

]

AndsotheNWwasobligedtoconfessthattheSunwasthestrongerofthetwo

AndsotheNWwasobligedtoconfessthattheSunwasthestrongerofthetwo

L-L%

] 29

Page 30: Intonational phonology in Bengali and English infant

PreviewofBengali-specificresults

¡  BengaliIDSinvolves:l  Decreaseinpitchaccentsoveralll  Increasein2PAtypes:fH*,L+fH*l  IncreaseinIPsl  IncreaseinHL%andHLH%boundarytones

30

Page 31: Intonational phonology in Bengali and English infant

0.00

0.05

0.10

0.15

non−IDS idsStyle

Rel

ative

freq

uenc

y

subj●

f01f02f03f04f05m01m02m03m04m05

3)Bengali:pitchaccents

¡  f-markedpitchaccentuseishigherinIDSforallbutonespeakerl  fH*l  L*+fH

31

Page 32: Intonational phonology in Bengali and English infant

3)Bengali:pitchaccents

fH*

thatmuchtravelertheirshawlheldtightly(IDS)

thatmuchtravelerhis/hershawlheldtightly(non-IDS)

L*

32

Page 33: Intonational phonology in Bengali and English infant

f01 f02 f03 f04 f05

m01 m02 m03 m04 m05

0

50

100

150

200

0

50

100

150

200

0

50

100

150

200

0

50

100

150

0

50

100

150

200

0

50

100

150

200

0

50

100

150

200

0

50

100

150

200

0

50

100

150

200

0

50

100

150

200

non−IDS ids non−IDS ids non−IDS ids non−IDS ids non−IDS ids

non−IDS ids non−IDS ids non−IDS ids non−IDS ids non−IDS idsStyle

Frequency

Pitch accent L* H* L*+H * L*+fH fH*

byspkr.

fH*,L*+fHinnon-IDS

fH*,L*+fHinIDS

33

Page 34: Intonational phonology in Bengali and English infant

4)Bengali:IPs

¡  Onaverage,Bengalispeakersproduced49.0%(=8.97)moreIPsinIDS

34

Page 35: Intonational phonology in Bengali and English infant

f01 f02 f03 f04 f05

m01 m02 m03 m04 m05

0

50

100

0

50

100

non−IDS ids non−IDS ids non−IDS ids non−IDS ids non−IDS idsStyle

Frequency

byspkr.

35

Page 36: Intonational phonology in Bengali and English infant

4)Bengali:IPs

LH% H% L%

L%

] ] ]

]Atthatmomentatravelerwearingaheavyshawlcamewalkingtowardsthem

Atthatmomentatravelerwearingaheavyshawlcamewalkingtowardsthem

36

Page 37: Intonational phonology in Bengali and English infant

3)Bengali:boundarytones

¡  TheincreaseinIPscanbelargelyattributedtoincreasesinthoseendingin:l HL%(highfalling)l HLH%(highfalling-rising)

37

Page 38: Intonational phonology in Bengali and English infant

f01 f02 f03 f04 f05

m01 m02 m03 m04 m05

0

25

50

75

0

20

40

60

0

20

40

60

0

20

40

0

20

40

60

0

20

40

60

0

25

50

75

0

50

100

0

20

40

60

0

25

50

75

100

non−IDS ids non−IDS ids non−IDS ids non−IDS ids non−IDS ids

non−IDS ids non−IDS ids non−IDS ids non−IDS ids non−IDS idsStyle

Frequency

IP tone L% H% LH% HL% HLH% M% ambig

byspkr.

HL%,HLH%inIDS

HL%,HLH%innon-IDS

38

Page 39: Intonational phonology in Bengali and English infant

3)Bengali:boundarytones

Hainnon-IDSDefault

HLH%inIDSContinuation

HL%inIDSTopicalization

39

Page 40: Intonational phonology in Bengali and English infant

Summaryofresults

¡  TrueforIDSinbothlanguages:l  NoincreaseinnumberofPAsoveralll  IncreaseinnumberwithinsubsetofPAs

¡  L+fH*andfH*inBengali¡  L+H*inEnglish

l  IncreaseinnumberofIPs¡ Certainboundarytonesweremorecommon

¡  So,whydoweseethesemodifications?

40

Page 41: Intonational phonology in Bengali and English infant

Discussion

41

Page 42: Intonational phonology in Bengali and English infant

Why:PAsengageinfant

¡ WhydoesIDSinvolveanincreaseinnon-defaultaccents?l  EnglishbitonalPAs,esp.L+H*l  BengaliH*,fH*,andL*+fH

¡ Morepitchvariation,toengagetheinfant’sinterest1

¡ Moretonesinvolvingexpandedpitchrangeasinfantspreferhigherpitch2

1Fernald1991,Werker&McLeod19892Kearsley1973,Fernald&Kuhl1981 42

Page 43: Intonational phonology in Bengali and English infant

Why:PAsmarkinfostructure

¡  Sowhydon’tallpitchaccentsinIDSbecomehigh/rising?

¡  Changeindistributionisrestricted¡  Theseparticularhigh/risingtonesmark

focusedelements1

1Pierrehumbert&Hirschberg(1990)forEnglish,Khan(2008,2014)forBengali 43

Page 44: Intonational phonology in Bengali and English infant

Why:PAsmarkinfostructure

¡  UseoffH*,L*+fHinBengaliincreasesfor:l  Wh-words,wordswithfocusencliticsl  Modifiers,e.g.warm,immediately

¡  UseofL+H*inEnglishincreasesfor:l  Turningpointsonsubjectarguments:

¡ “…theNorthWindgaveuptheattempt.ThentheSunshinedoutwarmly.”

l  Alternativesonascale,e.g.more,stronger,first

èGreateruseoffocusprosodyinIDS1

1IDSalsoinvolvesgreateruseoffocusmovementinthesyntax(Fernald&Mazzie1991).44

Page 45: Intonational phonology in Bengali and English infant

Why:phrasingengagesinfant

¡ WhydoesIDSinvolveanincreaseinIPs?¡ MoreIPboundarytonesmeansmoretones

involvingexpandedpitchrange…¡ …andmorepitchvariation

45

Page 46: Intonational phonology in Bengali and English infant

Why:phrasingmarksinfostructure

¡ WhyelsedoesIDSinvolvemoreIPs?¡  IPbreakshelpdemarcatesyntactic

structure¡  IPboundarytonesconveyinformation

structure

46

Page 47: Intonational phonology in Bengali and English infant

Why:phrasingmarksinfostructure

¡  NotallIPboundarytonesareincreasedinuseinIDS(atleastinBengali)l  L%islesscommoninIDS

¡  Thosewhoseuseisincreasedinclude:l  LH%,HLH%:continuationrisesl  H%,HL%:backgrounding/topicalization

èMoreexplicitmarkingofinformationstructureinIDS

47

Page 48: Intonational phonology in Bengali and English infant

Conclusions

48

Page 49: Intonational phonology in Bengali and English infant

Conclusions

¡ WecomparedIDSvs.non-IDS:l  IDShasmoretoneswithgreaterpitchrangeandmodulation,whichcanelicit/maintainattentionandbuildrapport

l  IDShasmoreexplicitmarkingofinfostructure

49

Page 50: Intonational phonology in Bengali and English infant

Conclusions

¡ WecomparedBengalivs.English:l  Bengaliusesmoreboundarytoneswithmoreinflectionpoints

l  Bengaliusesmoretopic-markingtonesl  EnglishhasmoreIPsinIDS,butdistributionofdifferentboundarytonesremainsconstant

50

Page 51: Intonational phonology in Bengali and English infant

Conclusions

¡  GrowingliteratureonroleofgrammarinconstrainingIDSinlexicaltone/LPAlgs(Mandarin1,Thai2,Japanese3)

¡  Firstsuchstudyonlanguageswithoutlexicaltonalcontrasts

Intonationisconditionedbybothattentional/emotionalmotivationsandgrammaticalstructure

1Liuetal(2007),2Kitamuraetal.(2002),3Igarashietal(2013) 51

Page 52: Intonational phonology in Bengali and English infant

Acknowledgments

Manythankstoourtranscribers,ourspeakers,andeveryoneintheaudience!

52