27
PhD-summer academy Santiago de Chile 27.8. – 10.9.2008 Multimodal human-machine interaction in different application scenarios

Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

  • Upload
    others

  • View
    10

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

PhD-summer academySantiago de Chile27.8. – 10.9.2008

Multimodal human-machineinteraction in different application

scenarios

Page 2: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

DAAD –Deutsche Sommerakademie:‘Guidance and Control ofAutonomous Systems‘

D. Söffker

W. Luther

Engineering Faculty, University Duisburg-Essen

The idea

Page 3: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal
Page 4: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Exchange DuE-UdC 1999-2003• The results which we expect to obtain through the joint

activities consist in the acquisition of experience andknowledge, as well as the development of new tools inthe following areas:

• Cooperative use of Java-based replicated applications(WhiteBoard, Document processing, Discussing Board),developing and evaluating benchmark applications forthe didactic network tool. Modeling, constructing andimplementing virtual environments through dynamiclearning materials. Discussing new ideas for interfacesusing complementary perception channels, concretemodeling including 3D, sound and tactile models,automatic generation of adequate concept keyboards.

Networked Multimedia Systems for Innovative Teaching and Learning Scenarios

Page 5: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Meetings and longer stays• 1999 Kick off meeting in Santiago• 2000 Santiago, Viña, Renaca, Puero Varas• 2001 Punta Arenas, N. B. guest professor in Duisburg• 2002 Temuco• 2003 Santiago, Valparaiso• 2004 N. B. & W. L. guest professors, Iquique• 2005 Valdivia• 2006 WCC Santiago, N. B. guest professor in Duisburg• 2008 Summer Academy in Santiago• Since 2000: N. B. visiting professor at University of

Waseda

Page 6: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Current exchange DUE-SdC-Waseda

?Wanted

Nelson Baloian

Frank Tewissen

Alex Berges Tiago Hassler

Jens Hardings

Prof. Matsumoto

Page 7: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Programme

• DAAD PhD Net 2 call• Workshops/Summer Schools

– Cooperation with partner universities– Bi-national PhD theses– Promote common PhD programmes– Find PhD students– Come together

Page 8: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Human-Machine Interaction inNetworked Systems

• Santiago de Chile 27.8 2008 - 10.9.2008– Multimodal human-machine interaction in

different application scenarios• Duisburg 29.7.2009 - 12.8.2009

– Interface and interaction design for learningand simulation environments

• Waseda February 2010– Collaborative learning interactions in

communities of practice and learning

Page 9: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Synoptic lecturers‘ scheme

Four local and four foreign lecturers16 PhD fellows

Page 10: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Santiago de Chile

Page 11: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Santiago de Chile (2)

Page 12: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Topics• Multimodal human-machine interaction in different

application scenarios– Human machine interaction– Social networks– Gesture-based interaction– Interface and interaction redesign

• Computer Supported Collaborative Learning / CSCW– Modeling groupware systems– Evaluation methods– Learning paradigms

• Communication systems– Optical networks

Page 13: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Invited lectures

• Algorithms and software design – efficiencypurpose

• Text searching algorithms• Construction of virtual generators• High speed networks’ applications

Page 14: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Schedule 1

**Empanadazohosted byDCC

18:00

* Visit toPalacioCousiño

ThematicOrientation (W.Luther)

16:30 18:00

Students(Kazaura)Christian SousaYanru Chen

Ochoa (Students)A. NeyemJ.. RodriguezA. Monares

Students(Söffker)D. GamradH. Oberheid

HardingsInteractionwith andthroughnetworks

Welcome(Dean of thefaculty,Prof. F.BrievaG. Navarro - N.Baloian)

14:30 16:30

Special Lecture:E. Vera

Photonic Networks

Special Lecture 1E. LeissWhen goodalgorithms yieldbad software

SöffkerHardings11:30 13:00

KazauraOpticalCommunicationSystems

OchoaDevelopingmobileApplications

* Visit to avinery

* CityWalk

SöffkerModellingHuman-machineInteraction

HardingsTrust &Reputation

9:30 11:00

Tue.02.09.08Mon.01.09.08Sun.31.08

Sat.30.08

Fri. 29.08Thu. 28.08Wed. 27.8

Page 15: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Schedule 2

Social eventGood bye

18:00

Baloian(Students)D. JureticS. Kreft

Pino(Students)V. Herskovic

Luther(Students)B. WeyersR. Cuypers

Urano(Students)Ye Kyaw ThuSong Liu

14:30 16:30

ClosingSection

Special Lecture:Benjamin BustosFeature-basedsimilarity searchin data objectbasesDr. Tobias SchreckSearch and VisualAnalysis inComplexInformation

Baloian* LosDominicos

* Valparaiso& Viña(seaside)

PinoLutherSpecialLecture:R. PalmaTowards theconstructionof virtualGenerators

11:30 13:00

AcademyResults andForthcoming activities

ProgramDiscussion,Lecturers/ PhDStudents

BaloianGestureBasedInteraction

PinoEvaluatingCollabora-tive Work

LutherInterface &Interactionredesign

UranoNew LearningParadigms

9:30 11:00

Wed.10.9.08

Tue. 09.09.08Mon.08.09

Sun.07.09

Sat. 06.09Fri. 05.09.08Thu.04.09.08

Wed. 03.9.08

Page 16: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Short presentation of theparticipantsMain interests

Topics of the talks

Page 17: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Participants UdCProf. Dr. Nelson BaloianComputer Supported Collaborative Learning

Gesture-based Interaction – framework and applications

PhD FellowsSebastian Kreft, Masterstudent im DCCD. Juretic, Masterstudent im DCC

Prof. Dr. Jens HardingsInformation Technology and Security

Interaction with and through social networksTrust and Reputation: direct and indirect methods

PhD FellowsAlejandro FuentesAna Fernández

Page 18: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Participants UdC (2)Prof. Dr. Sergio OchoaComputer Supported Collaborative Learning,Service-Oriented Mobile Units to Support Collaboration

Modeling mobile groupware systems

PhD FellowsAndres Neyem, Fellow of CONICYTJ. Rodriguez, A. Monares

Prof. Dr. José PinoComputer Supported Collaborative Work and Human Computer Interaction

Evaluating Collaborative Work

PhD FellowsValeria Herskovic, PhD Student and CONICYTSebastian Poblete, Master Student DCC

Page 19: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Participants from WasedaProf. Dr. Yoshiyori Urano Head of GITSMultimedia Educational Environment, Distance Learning,Distributed & Collaborative Learning

Global Collaboration for constructing new Learning Paradigms

PhD FellowsYe Kyaw Thu, Song Liu (could not come unfortunately)

Dr. Kamugisha KazauraCommunication Systems, Networks

Research and Development of Next Generation Free-SpaceOptical Communication System

PhD FellowsChen Yanru, Christian Sousa

Page 20: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Participants from DuisburgProf. Dr. Wolfram LutherComputer Graphics and Image Processing –Scientific Computing – Virtual 3D Environments

Interface and interaction redesign on the fly – framework and applications

PhD FellowsBenjamin Weyers, Roger Cuypers

Prof. Dr.-Ing. Dirk SöffkerChair of Dynamics and Control

Modeling of human machine interaction

PhD FellowsDipl.-Ing. Henrik Oberheid, Dipl.-Ing. Dennis Gamrad

Page 21: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Special LecturesDr. Ernst L. Leis (Vienna):When Good Algorithms Yield Bad Software

Benjamin Bustos (UdC)Feature-based similarity search in data object basesDr. Tobias Schreck (Darmstadt)Search and Visual Analysis in Complex Information

Dr. Eduardo Vera (Center for Mathematical Modeling, DCC)Ultra-high Speed Photonics Networks in Chile for newadvanced ICT applications in Astronomy and Mining

Dr. R. PalmaTowards the construction of virtual Generators

Page 22: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Learning styles (1)

Page 23: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Learning styles (2)

Page 24: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Learning styles (3)

Page 25: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Starting28.08. 9.30hJens Hardings: Trust & Reputation

Interaction with and through networks

Have a good time!

Thanks to the organizers at DCCTechnical remarks:Please send a pdf-version of your slides to the organizersSponsoring by DAAD: approximately 1.200.000 CLP pp will be

distributed at the end of the academy

Page 26: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Program discussion

• Evaluation– Statements

• Common projects– Conferences, meetings

• Next academies– Duisburg 29.7.2009 - 12.8.2009– Waseda 24.02.2010 - 10.03.2010– Find new sponsors for mutual visits

• To do– Proceedings – Deadline 01.10.2008– Introducing texts, common style sheet

Page 27: Multimodal human-machine interaction in different ...nbaloian/SADUEWA... · Human-Machine Interaction in Networked Systems • Santiago de Chile 27.8 2008 - 10.9.2008 – Multimodal

Evaluation Sept. 9

Round table discussion

Collect the money forlunch

Two weeks duration

Social life at thebeginning

Common meals

Special lectures –cognitive sciences

One group one day sameformatProfessors in the morningStudents in the afternoon

Social interaction – groupwork – social interactions

Special lectures dependingon the personal interests

Introductory session -short presentations

New topics

Provide presentationtopics of students

Good presentation anddiscussion

Provide the materialbefore the talk

Should not be too diversetopics

Certain informalityAdditionalnegativePositive