Workshop Programme Multimodal Corpora From Multimodal ... Corpora...¢  "Multimodal Corpora From Multimodal

  • View
    9

  • Download
    0

Embed Size (px)

Text of Workshop Programme Multimodal Corpora From Multimodal ... Corpora...¢  "Multimodal...

  • Workshop Programme "Multimodal Corpora

    From Multimodal Behaviour Theories to Usable Models" Saturday 27 May 2006 http://wwwhomes.uni-bielefeld.de/mmc06/

    9:00 Welcome & Introduction J.-C. Martin, P. Küehnlein, P. Paggio, R. Stiefelhagen, F. Pianesi 20 mn per presentation + 10 mn of questions 9:15 MEETING & METADATA 9h15 - 9h45 Working with Very Sparse Data to Detect Speaker and Listener Participation in a Meetings Corpus Nick Campbell & Noriko Suzuki 9h45 - 10h15 Multimodal Annotated Corpora of Consensus Decision Making Meetings Fabio Pianesi, Chiara Leonardi, Massimo Zancanaro 10h15 - 10h45 Language Resource Archiving supporting Multimodality Research Peter Wittenburg, Daan Broeder, Peter Berck, Han Sloetjes, Alex Klassmann 10:45 Discussion 11:00 Coffee Break 11:30 HAND GESTURES 11h30 - 12h Analysis of gesture expressivity modulations Nicolas Ech Chafai, Catherine Pelachaud, Danielle Pelé 12h - 12h30 Synthesizing Gesture Expressivity Based on Real Sequences George Caridakis, Amaryllis Raouzaiou, Kostas Karpouzis, Stefanos Kollias 12h30 - 13h An Annotation Scheme for Conversational Gestures: How to economically capture timing and form Michael Kipp, Michael Neff, Irene Albrecht 13h - 13h30 Using FORM Gesture Data to Predict Phase Labels Craig Martell, Joshua Kroll

    i

  • 13:30 Lunch

    14:45 MULTIMODALITY DURING CONVERSATION

    14h45 - 15h15 Degrees of freedom of facial movements in face-to-face conversational speech Gérard Bailly, Frédéric Elisei, Pierre Badin & Christophe Savariaux 15h15 - 15h45 A coding scheme for the annotation of feedback, turn management and sequencing phenomena Jens Allwood, Loredana Cerrato, Kristiina Jokinen, Costanza Navarretta and Patrizia Paggio 15h45 - 16h15 A framework for analyzing embodied communicative feedback in multimodal corpora Jens Allwood, Stefan Kopp, Karl Grammer, Elisabeth Ahlsén 16:15 Discussion 16:30 Coffee break

    17:00 MULTIMODAL HCI 17h - 17h30 A Study into Multimodal Behaviour in Error Correction Marie-Luce Bourguet 17h30 - 18h Making a Case for Spatial Prompting in Human-Robot Communication Anders Green, Helge Hüttenrauch 18h - 18h30 The MIMUS Corpus Pilar Manchón Portillo, Carmen del Solar Valdés, Gabriel de Amores Carredano, Guillermo Pérez García 18:30 Discussion 19:00 End of Workshop

    ii

  • Workshop Organiser(s)

    Jean-Claude MARTIN, CNRS-LIMSI / Univ. Paris 8-LINC

    Peter KÜEHNLEIN, Bielefeld University

    Patrizia PAGGIO, Centre for Language Technology (CST), University of Copenhagen

    Rainer STIEFELHAGEN, Universitaet Karlsruhe (TH), Interactive Systems Labs, ITI

    Fabio PIANESI, Istituto Trentino di Cultura - Centro per la Ricerca Scientifica e Tecnologica (ITC-irst)

    Workshop Programme Committee Jens Allwood, Univ. Goteborg, SE

    Elisabeth Ahlsén, Univ. Goteborg, SE Elisabeth André, Univ. Augsburg, D

    Gérard Bailly, CNRS-STIC, FR Tom Brøndsted, Univ. of Aalborg Stéphanie Buisine, ENSAM, FR

    Susanne Burger, Carnegie Mellon University, Pittsburgh, PA, USA Geneviève Calbris, ENS LSH Lyons & CNRS UMR 8606, Paris, FR

    Loredana Cerrato, KTH TMH-CTT, SE Piero Cosi, ISTC-SPFD CNR, I

    John Glauert, University of East Anglia Dirk Heylen, U Twente, NL

    Bart Jongejan, CST, Univ. of Cph, DK Kostas Karpouzis, ICCS, G

    Michael Kipp, DFKI Saarbrucken, D Stefan Kopp, SFB 360, D, S.

    Alfred Kranstedt, SFB 360, D Peter Küehnlein, Bielefeld University, D

    Daniel Loehr, MITRE, USA Ian Marshall, University of East Anglia Jean-Claude Martin, CNRS-LIMSI, F

    Costanza Navarretta, CST, Univ. Of Cph, DK Patrizia Paggio, CST, Univ. Of Cph, DK

    Catherine Pelachaud, Univ. Paris, FR Fabio Pianesi, ITC, I

    Isabella Poggi, Univ. Roma Tre, I Jan-Peter de Ruiter, MPI, NL

    Ielka van der Sluis, U Aberdeen, UK Rainer Stiefelhagen, Universitaet Karlsruhe, D

    Janienke Sturm, Univ. Nijmegen, NL Peter Wittenburg, MPI Nijmegen, NL

    Massimo Zancanaro, ITC, I

    iii

  • Table of Contents

    Introduction ..............................................................................................................................................................vi J.-C. Martin, P. Küehnlein, P. Paggio, R. Stiefelhagen, F. Pianesi Working with Very Sparse Data to Detect Speaker and Listener Participation in a Meetings Corpus.......................1 Nick Campbell & Noriko Suzuki Multimodal Annotated Corpora of Consensus Decision Making Meetings ...............................................................6 Fabio Pianesi, Chiara Leonardi, Massimo Zancanaro Language Resource Archiving supporting Multimodality Research ........................................................................10 Peter Wittenburg, Daan Broeder, Peter Berck, Han Sloetjes, Alex Klassmann Analysis of Gesture Expressivity Modulations.........................................................................................................15 Nicolas Ech Chafai, Catherine Pelachaud, Danielle Pelé Synthesizing Gesture Expressivity Based on Real Sequences..................................................................................19 George Caridakis, Amaryllis Raouzaiou, Kostas Karpouzis, Stefanos Kollias An Annotation Scheme for Conversational Gestures: How to economically capture timing and form....................24 Michael Kipp, Michael Neff, Irene Albrecht Using FORM Gesture Data to Predict Phase Labels ................................................................................................29 Craig Martell, Joshua Kroll Degrees of Freedom of Facial Movements in Face-to-face Conversational Speech.................................................33 Gérard Bailly, Frédéric Elisei, Pierre Badin & Christophe Savariaux A Coding Scheme for the Annotation of Feedback, Turn Management and Sequencing Phenomena .....................38 Jens Allwood, Loredana Cerrato, Kristiina Jokinen, Costanza Navarretta and Patrizia Paggio A Framework for Analyzing Embodied Communicative Feedback in Multimodal Corpora ...................................43 Jens Allwood, Stefan Kopp, Karl Grammer, Elisabeth Ahlsén A Study into Multimodal Behaviour in Error Correction .........................................................................................48 Marie-Luce Bourguet Making a Case for Spatial Prompting in Human-Robot Communication.................................................................52 Anders Green, Helge Hüttenrauch The MIMUS Corpus .................................................................................................................................................56 Pilar Manchón Portillo, Carmen del Solar Valdés, Gabriel de Amores Carredano, Guillermo Pérez García

    iv

  • Author Index

    Ahlsén ............................................................. 43

    Albrecht........................................................... 24

    Allwood..................................................... 38, 43

    Badin ............................................................... 33

    Bailly............................................................... 33

    Berck ............................................................... 10

    Bourguet.......................................................... 48

    Broeder............................................................ 10

    Campbell ........................................................... 1

    Caridakis ......................................................... 19

    Cerrato............................................................. 38

    de Amores Carredano ..................................... 56

    del Solar Valdés .............................................. 56

    Ech Chafai....................................................... 15

    Elisei ............................................................... 33

    Grammer ......................................................... 43

    Green............................................................... 52

    Hüttenrauch..................................................... 52

    Jokinen ............................................................ 38

    Karpouzis ........................................................ 19

    Kipp................................................................. 24

    Klassmann....................................................... 10

    Kollias ............................................................. 19

    Kopp................................................................ 43

    Kroll ................................................................ 29

    Leonardi ............................................................ 6

    Manchón Portillo ............................................ 56

    Martell............................................................. 29

    Navarretta........................................................ 38

    Neff ................................................................. 24

    Paggio ............................................................. 38

    Pelachaud ........................................................ 15

    Pelé.................................................................. 15

    Pérez García .................................................... 56

    Pianesi ...............................................................