Mixed Reality Research in Design

Xiangyu Wang, Ph.D.Design Computing Honour Pre.

SeminarMarch 2008

Agenda

• Augmented Reality for Urban Design

• Tangible Augmented Reality for Design Learning

• Augmented Virtuality for Remote Design Collaboration

Introduction

• Mixed Reality Continuum (Milgram et al. 1999)

Identification of Mixed Reality within the Reality-Virtuality Continuum

Tangible Augmented Reality for Design Learning

• Tangible interface (haptic)+Augmented Reality(visual)

Tangible Augmented Reality for Design Learning

The Actuated Workbench based on tangible user interface (Pangaro, G., Maynes-Aminzade, D., Ishii, H., 2003)

Tangible Augmented Reality for Design Learning

A 3D graphics image overlaid onto the scene (Asai, Kobayashi and Kondo 2005)

Tangible Augmented Reality for Design Learning

Theoretical process for applying tangible AR concept and technology into design learning

Tangible Augmented Reality for Design Learning

Setup sketch for tangible AR system

Taxonomy of Mixed Reality Learning Environments

• Dimensions of the taxonomy– Learning media and tools– Learning styles– Learning modality

Taxonomy of Mixed Reality Learning Environments

Approximate locations of MRLE examples within the MR global continuum

Augmented Virtuality for Remote Design Collaboration

• The objective is to define and prototype an AV interface that maximizes the designer’s ability to comprehend the design and effect corresponding actions in the display space under the given conditions.

System Architecture• Max/Msp • Jitter• Google SketchUp Pro 6

System Architecture• Real video stream as environment texture. • “See through the window” as if he/she is in the

remote location.

Video as Texture

AV Space Implementation

Multi-Projection System.

AV Space Implementation

An Augmented Virtuality scene rendered by multi-projection screen.

AV Space Implementation

Photo as Texture (Information Board)

AV Space Implementation

AV Design Environment 1 AV Design Environment 2

• It clearly shows the detailed environmental view.