Upload
others
View
8
Download
0
Embed Size (px)
Citation preview
Rhythm and Melody
Aspects of Language and Music
Dafydd Gibbon
Guangzhou, 25 October 2016
Orientation
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 3
Orientation - 1
● Language:● focus on speech, conversational spoken language
– not written text● focus on complex behavioural performance
– more than speculation on language cognition or ‘competence’
● Music:● focus on solo song
– more than instrumental music– and not ‘written’ or orchestral music
● focus on complex behavioural performance– more than speculation on musical cognition or ‘competence’
● Method:● discipline: more phonetic than linguistic● syncretistic: intuition plus measurement
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 4
Orientation - 2
● What is rhythm?● Ella Fitzgerald: “I have rhythm.”
– Spoken English type of ‘foot-timed’ rhythm
● What is melody?● Bob Dylan: “The answer is blowing in the wind.”
– Spoken English type of intonation-like melody
● Rhythm and melody:● other cultures, languages, registers:
– West African dirges (funeral songs / chants)– Chinese popular songs: tone match in speech and song?– Children’s chants: speech or music?– Surrogates: whistled speech (e.g. calls, interjections)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 5
Controversies
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 6
Controversies – musical relativity
● Are there universals of language and speech?● Is there language-specific ‘musical relativity’?
● does music shape language?● Does language shape music?● Does music shape thought?
cf. ‘linguistic relativity’, the claim that language shapes thought
● A speculative example:– Robert Hall claimed
● Elgar’s music is mostly popular in Britain because it is heavily influenced by Standard British English intonation:
● very wide pitch range● sudden changes of pitch height (e.g. musical 7th interval)● Hall, R. A. Jr. 1953. Elgar and the intonation of British English.
Gramophone 31, 6.
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 7
Controversies – types of musical relativity
● Musical relativity:– Is music shaped by speech? - To some extent:
– chant: adapted to restricted rhythms and melodies of speech– song: often adapted to a broader range of rhythms and
melodies of speech– instrument: phonaesthetic imitation of speech rhythms and
tonal melodies– surrogates: drumming, whistling with speech rhythms and
tonal melodies
– Is speech shaped by music? - To some extent:– music-like contours in greetings and calls - “Good morning!”,
“Jooohnyyy!”– song: speech rhythms and melodies adapted to musical
conventions
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 8
Controversies – conventions of music and speech
● Speech and music are both● complex modes of human behaviour● complex modes of human cognition:
● Speech:● conventions shaped by local, especially family
communation● formalised by public and written communication
● Music:● conventions shaped by social community activity:● increasingly formalised in larger communities: celebration,
religion, courtship
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 9
Controversies – co-evolution of music and speech?
● Both speech and music may have● Shared phases in the evolution of behaviour● Shared phases in the evolution of cognition?
● A speculation on co-evolution:● first simple vocalisations and gestures
– then sequential iteration leading to rhythm – synchrony with other bodily activities?
– then parallel iterated signals– finally speech and music with complex recursive iterations
● Compare language acquisition by children:– first rhythm and melody, then vocabulary and grammar
● Compare animal behaviour:– simple rhythms of animal speech, from barking dogs to birds– simple melodies from birdsong to complex primate ape cries
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 10
Other Aspects of Language and Music
● Meaning in language and music– semantic: for example sound symbolism
● such as imitating voices, animals, natural events
– pragmatic:● for example emotions
– It is claimed that music can express the emotions joy, tenderness, longing, coquetry, surprise, fear, complaint, scorn, anger, sarcasmFonagy, I., K. Magdics (1963). Emotional patterns in intonation and music. Zeitschrift für Phonetik, Sprachwissenschaft und Kommunikationsforschung 16, 293-313.
● for example styles – classical, romantic, blues, ...
● But here we concentrate on sound patterns
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 11
Pitch (melody) – Spectrum (timbre) – Time (rhythm)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 12
Pitch (melody) – Spectrum (timbre) – Time (rhythm)
time
Signal time domain ≈ waveform (oscillogram): top, blackMelody ≈ fundamental frequency (F0, f0, pitch track/trace): bottom, blueTimbre ≈ spectrogram (harmonics/overtones, formants)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 13
Visualising Speech Melody: “Good morning!”
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 14
Four ways of saying “Good morning!”
waveform fundamental frequency track annotation
Visualisation with Praat phonetics software
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 15
Four ways of saying “Good morning!”
Visualisation with Praat phonetics software
Pitch movements on vowels (syllable centres)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 16
Four ways of saying “Good morning!”
Visualisation with Praat phonetics software
Approximate pragmatic meanings
NormalExpecting interaction
Surprise encounter
Greeting at a distance
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 17
Visualising Speech Rhythm
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 18
Visualising Speech Rhythm
Regular rhythm, ‘syllable timing’, ‘syllable isochrony’
Regular rhythm, ‘foot / stress timing’, ‘foot isochrony’
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 19
Speech Rhythm and Grammar
● Rhythm and phrasing:– Resolution of ambiguity of modifier scope:
● old men and women will stay here– (old (men and women)) will stay here– ((old men) and women) will stay here
– Resolution of ambiguity of operator scope:● he did not leave because he was tired
– he did (not (leave because he was tired))– he did (not leave) because he was tired
– Resolution of prepositional phrase attachment● I saw the man on the hill with a telescope
– I saw (the man on the hill) with a telescope– I saw the man (on the hill with a telescope)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 20
Speech Rhythm and Grammar
● Rhythm and focus:– Neutral focus:
● I like red SHIRTS
– Emphatic focus:● I LIKE red shirts
– Contrastive focus:● Jack likes red SHIRTS● Jack likes RED shirts● Jack LIKES red shirts● JACK likes red shirts● JACK likes RED shirts
...
With four constituents, there are 16 possibilities.
Depending on the intensity of the pitch
accent, these may be ambiguous
... but not red HATS
... but not BLUE shirts
... but does not HATE red shirts
... but not JIM,
...
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 21
Rhythm and Melody: Comparing Speech and Music
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 22
Spoken language influences music (but not always)
● Song:● spoken language may influence music in
– rhythm– melody
● but this is not always true● and may be completely wrong for instrumental music
● English popular songs: speech tends to influence music● Rhythm:
– phrasing adapted to English grammar– accents adapted to Engllish stress and focus
● Melody:– local accents on syllables and words – global tunes and accents on phrases
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 23
Rhythm and Melody
● Spoken language and music share– melody
● changes in fundamental frequency of signal over time
– timbre● overtone (harmonic) pattern of signal:
– voice: different vowels, different voice qualities– music: resonance qualities of instrument
– rhythm● patterns of
– sequences of stronger and weaker elements– more or less regular intervals between stronger elements
● types– voice: stress timing, syllable timing, mora timing– music: 3/4, 4/
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 24
Rhythm
musicspeech= ?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 25
Rhythm
song
musicspeech
instrumentaltalk
= ?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 26
Rhythm
song
musicspeech
instrumentaltalk
rhythm of speech rhythm of music
= ?
= ?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 27
Melody
musicspeech= ?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 28
Melody
song
musicspeech
instrumentaltalk
= ?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 29
Melody
song
musicspeech
instrumentaltalk
melody of speech melody of music
= ?
= ?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 30
Putting Things Together:
The Sounds of Language
The Sounds of Music
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 31
WORD
Speech (Spoken Language)
SPEECH
vowels(resonant)
toneconsonants
(noisy) duration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 32
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
vowels(resonant)
toneconsonants
(noisy)intonation phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 33
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
vowels(resonant)
toneconsonants
(noisy)
speech sounds
intonation phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 34
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
melody
vowels(resonant)
toneconsonants
(noisy)
speech sounds
intonation phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 35
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
melody rhythm
vowels(resonant)
toneconsonants
(noisy)
speech sounds
intonation phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 36
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
melody rhythmtimbre
vowels(resonant)
toneconsonants
(noisy)
speech sounds
intonation phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 37
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
melody rhythmtimbre
vowels(resonant)
toneconsonants
(noisy)
speech sounds
intonation phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 38
SENTENCE
WORD
Speech (Spoken Language)
SPEECH
melody rhythmtimbre
vowels(resonant)
toneconsonants
(noisy)
speech sounds
intonation
voice quality
phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 39
PHRASE
BAR
From Speech to Music
MUSIC
melody rhythmtimbre
?note ?
?
tune
instrument type
phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 40
PHRASES
BARS
Music + Speech = Song
MUSIC
melody rhythmtimbre
vowels(resonant)
noteconsonants
(noisy)
speech sounds
tune
instrument type
phrasingduration
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 41
Parallel Signals in Speech and Music
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 42
Parallel ‘melodies’ in speech and music
● Speech:– 2 (or more) speakers in
dialogue: usually sequential
– multimodal streams:● locutions
– distinctive features● prosody
– global intonation– local tones
● gesture
● Music– 2 (or more) musicians in
orchestra / band: usually parallel
– multimodal streams● text, lyrics● music
– harmonies–
– accompanying behaviour
http://www.ted.com/talks/bobby_mcferrin_hacks_your_brain_with_music
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 43
Rhythm (or lack of it)
words, sentences
Speech (spoken language)with physical forms and
semantic / pragmatic meanings
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 44
Parallel signal streams in communication
melody
overtonesnoise
silence
Choice of instrumentsfor production, transmission, perception
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 45
Parallel signal streams in communication
words, sentences
melody
overtonesnoise
silence
Choice of instrumentsfor production, transmission, perception
Speech (spoken language)with physical forms and
semantic / pragmatic meanings
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 46
Melody
melody
overtonesnoise
silence
Choice of instrumentsfor production, transmission, perception
Tone languagesTone
Chinese, Igbo,Pirahã, ...
Pitch accent
Japanese, Swedish
Prominence
English, German
Lexical: contrast, structure, word formation
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 47
Melody
melody
overtonesnoise
silence
Choice of instrumentsfor production, transmission, perception
Tone languagesIntonation
All languages – but in different ways
Discourse: dialogue acts, turn-taking
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 48
Melody in Song, an Example: Bob Dylan
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 49
Spoken language influences music (but not always)
● Discussion:– check the pitch trace in relation to grammatical categories
Bob Dylan, The answer is blowing in the wind.
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 50
Spoken language influences music (but not always)
● Discussion:– check the pitch trace in relation to grammatical categories
Bob Dylan, The answer is blowing in the wind.
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 51
Spoken language influences music (but not always)
Bob Dylan, The answer is blowing in the wind.
Check the pitch pattern in relation to grammatical categories, noting• changes in pitch movement• after each change, the direction of pitch movement• (falling, rising, level)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 52
Musical Melody and English Grammar
Listen to and describe the way the phrases are expressed and separated:
the answer, my friend, is blowing, in the wind
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 53
Musical Melody and English Grammar
Listen to and describe the way the phrases are expressed and separated:
the answer, my friend, is blowing, in the wind
the answer my friend is blowing in the wind the answer is blowing in the wind
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 54
Rhythm in Song, an Example: Ella Fitzgerald
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 55
Rhythm in Music
Ella Fitzgerald, “I got rhythm”
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 56
Rhythm in Music
Ella Fitzgerald, “I got rhythm”
Foot timing
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 57
Rhythm in Music
Ella Fitzgerald, “I got rhythm”
Foot timing
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 58
English Rhythm in Music
Ella Fitzgerald, “I got rhythm”
Foot timing
Special case: only unstressed syllables (anacrusis)
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 59
Musical Rhythm and English Grammar
Ella Fitzgerald, “I got rhythm”
Note that the musical structures ALMOST fit the grammatical structures!
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 60
Musical Rhythm and English Grammar
Ella Fitzgerald, “I got rhythm”
Note that the musical structures ALMOST fit the grammatical structures!
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 61
Musical Rhythm and English Grammar
Ella Fitzgerald, “I got rhythm”
Note that the musical structures ALMOST fit the grammatical structures!
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 62
Musical Rhythm and English Grammar
Ella Fitzgerald, “I got rhythm”
Note that the musical structures ALMOST fit the grammatical structures!
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 63
Musical Rhythm and English Grammar
Ella Fitzgerald, “I got rhythm”
Note that the musical structures ALMOST fit the grammatical structures!
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 64
Universals of Melody?
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 65
Between Speech and Song
● ‘Call contours’– stylised, flat pitches– musical intervals, e.g. minor 3rd (3 semitones)
● Chants:– childrens’ chants
● it’s raining, it’s pouring, the old man’s snoring, ...● cowardy cowardy custard, your face is made of mustard
– vendors’ sales chants– religious liturgical chants– rap
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 66
Universals of Melody: ‘Call Contours’
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 67
Universals of Melody: ‘Call Contours’
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 68
Universals of Melody: ‘Call Contours’
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 69
Universals of Melody: the Pentatonic Scale
Bobby McFerrin ‘playing’ an audience like a piano:
check your favourite search machine for a video clip with seach key combinations like ...
Bobby McFerrin pentatonicor
Bobby McFerrin Science Festival
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 70
Speculations and Conclusions
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 71
SHARED WITHBIRDS, ANIMALS
Speculations on Rhythm, Melody and Evolution
Increase in complexity over time
Simple sound events
Communicative timbre:speech,
recursive patterns
Communicative melody:
frequency modulation,parallel patterns
Communicative rhythm:
pulse modulation, iterative patterns
Music:recursive patterns
Song
Dafydd Gibbon, Guangzhou, 25 November 2016 Rhythm and Melody: Aspects of Language and Music 72
Summary and Conclusion
● Language and music many features– structural patterns:
● linear● hierarchical● parallel
– Language and music share functions:● identity:
– individual– community
● emotion
● But there are differences– which affect the speech-music relation in song– which may be due to partly independent evolution