18
Text- Text- t t o- o- s s peech peech a a udio udio d d escription with escription with a a udio udio s s ubtitling to a ubtitling to a n n on- on- f f iction iction film film La Soufriere La Soufriere by Werner Herzog by Werner Herzog Case study and results Case study and results Magdalena Mączyńska, University of Warsaw Magdalena Mączyńska, University of Warsaw Agnieszka Szarkowska, University of Warsaw Agnieszka Szarkowska, University of Warsaw London, 2 London, 2 8 8 June - 1 July 2011 June - 1 July 2011

Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

  • Upload
    others

  • View
    11

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Text-Text-tto-o-sspeech peech aaudio udio ddescription with escription with aaudio udio ssubtitling to a ubtitling to a nnon-on-ffictioniction film film La Soufriere La Soufriere

by Werner Herzogby Werner Herzog

Case study and resultsCase study and results

Magdalena Mączyńska, University of WarsawMagdalena Mączyńska, University of WarsawAgnieszka Szarkowska, University of WarsawAgnieszka Szarkowska, University of Warsaw

London, 2London, 288 June - 1 July 2011 June - 1 July 2011

Page 2: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Presentation outlinePresentation outline

• Rationale of the studyRationale of the study

• ParticipantsParticipants

• MaterialsMaterials

• MethodMethod

• Research questions Research questions andand selected results selected results

Page 3: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Rationale of the studyRationale of the study

Page 4: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Rationale of the studyRationale of the study

Page 5: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

ParticipantsParticipants

Page 6: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

ParticipantsParticipants

In total: In total: 8844 peopl peoplee32 32 blind, blind, 2222 partially sighted, partially sighted, 30 30 sightedsighted

Page 7: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

MaterialsMaterials

1977 Film1977 Film La SoufriereLa Soufriere directed by German directed by German director Werner Herzogdirector Werner Herzog

Text-to-speech application IVONA READERText-to-speech application IVONA READER

TwoTwo synthetic voices synthetic voices

Page 8: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

MaterialsMaterials

Page 9: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

AD script with subtitlesAD script with subtitles

Page 10: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

MethodMethod

ScreeningScreeningOnline surveyOnline survey

Page 11: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Research questionsResearch questions

TTS users more eager

to accept TTS AD?

TTS users more eager

to accept TTS AD?

A documentary

more suitable for

TTS AD?A documentary

more suitable for

TTS AD?

TTS AD as a temporary/ permanent

solution?

TTS AD as a temporary/ permanent

solution?

Page 12: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Research questionsResearch questions

83% TTS users – TTS AD temporary*

90% non-TTS users – TTS AD temporary*  

68% TTS users – TTS AD permanent*

70% non-TTS users – TTS AD permanent*

* refers to the blind and visually impaired people only

Page 13: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Selected results of the surveySelected results of the survey

Page 14: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

Selected results of the surveySelected results of the survey

Page 15: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

VoicesVoices of criticism?of criticism?

I had a feeling

I had a feeling that sometimes

that sometimes AD overlapsAD overlaps the the

dialoguesdialogues..

TThe original he original

soundtrack was soundtrack was

too loudtoo loud..

Monotonous

Monotonous intonation

intonation,, but I but I

understand that it was

understand that it was

TTS application.

TTS application.

It was difficult to

It was difficult to understand some

understand some words and phrases.

words and phrases.

Page 16: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

TiTiddbitbit

Audio description

made the viewing

way more interesting.Audio description

made the viewing

way more interesting.

Interesting and clear descriptions, wide vocabulary, congrats!

Interesting and clear descriptions, wide vocabulary, congrats!

A splendid cognitive experience!

A splendid cognitive experience!

Audio description

enriched the reception

of the film.

Audio description

enriched the reception

of the film.

30 sighted viewers30 sighted viewers 55% have never heard of 55% have never heard of

AD beforeAD before

Page 17: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

ConclusionsConclusions

TTS AD acceptableTTS AD acceptable to most respondents to most respondents

TTS ADTTS AD suitable for documentaries suitable for documentaries

Vast majority of participants accept TTS AD as Vast majority of participants accept TTS AD as a temporary solution (83%) as well as a a temporary solution (83%) as well as a permanent solution – alternative for AD read permanent solution – alternative for AD read by human narrator (69%)by human narrator (69%)

Page 18: Text-to-speech audio description with audio subtitling to ...avt.ils.uw.edu.pl/files/2012/04/TTS-AD-with-audio... · TTS ap plic ati on. T Sa p a It was difficul t to unders i ltt

For more information visit For more information visit www.avt.ils.uw.edu.plwww.avt.ils.uw.edu.pl

or conntact usor conntact [email protected]@uw.edu.pl

[email protected]@gmail.com