Interacting with a Virtual DancerContributions by D. Reidsma, A. Nijholt, H. Van Welbergen, R.W. Poppe, J . Vromen, R.J. Rienks, H. Hondorp, Pieter Bos

Contact: Prof. Dr. Ir. A. NijholtHuman Media Interactionanijholt@ewi.utwente.nlhttp://hmi.ewi.utwente.nl/

Ambient HipHop

Mutual interaction in a dance space “Dancing together” is more than “Dancing at the same moment on the same floor”. Dancers observe, react, adapt, invite, follow, lead... or intentionally ignore each other. Can we entice a human dancer to enter into this mutual interaction with a Virtual Dancer?

Input Database with a collection of (dance) moves.

•IK/Path Functions•Mocap

Observation of the Human Dancer•Global movement characteristics•Hand movements•Feet on dance pad•Eye contact and attention (not yet)

Analyse music•Beat and tempo detection (klapuri)•Longer term beat prediction•Rhythm analysis (not yet ready)

Research themes•Nonverbal interaction such as eye contact based invitation or mirroring•Implicitly influencing user•Style adaptations•Adaptive planning and animation•And more...

ApplicationECAs depending on mutual influences in interaction, with strong nonverbal aspects and complex timing issues, e.g.:•virtual dancer •virtual conductor•virtual trainer

Dancing with user‘Move’ selection in reaction to user; alternate (nonverbal) attempts at following user with attempts at leading user; challenge user to make new moves by mixing imitation and variation.

Align dance moves to music

Dance move key points:

Beat predictions:

InvitationUsing body language and simulated eye contact to invite the user to join the dance.

Bored/inactiveWait till user attention detected, then try to keep that attention captured (invitation).