Vision pk1

A DIY interactive 3-D device

Visions Project K.1.0

by Francesca Mereu and Javier Villarroel

(VLAB4D Visualization Advanced Group)

http://visionlab4d.com.ar

The Visions Project K. is a volumetric device that allows

pseudo visualization of 3-D objects and their interaction

with the user.

Visions Project K.

Visions Project K.

AIMS:

VISIONS Poject K. 1.0 (Interactive video hologram ), is research project on the

video holograms and interactive 3D devices, which was presented at the Medialab- Prado

Center for Digital Art Culture in Madrid in February 2012.

TO RESEARCH ON 3-D DISPLAY DEVICE AND DEVELOP A LOW COST

PROTOTYPE, EASY TO ASSEMBLE, THAT USE A OPEN SOURCE

SOFTWARE;

TO VISUALIZE 3-D IMAGE AS VIDEOHOLOGRAMS;

TO EXPERIMENT USER INTERACTION as EXPERIENCE WITH

3-D IMAGE FLOATING IN THE AIR: HAPTIC INTERACTION AND VISUAL

INTERACTION.

Firstprototype: Medialab-Prado 2009

Objects are projected onto a pyramidal structure with a LCD monitor, and due

to the special geometry of the structure, it looks like real 3-D objects floating

inside the pyramid for any observer from any direction.

Visions Project K.

How visualize 3-D images

Visions Project K.

Optical System

Visions Project K.

There are 2 types of interaction user: visual and haptica

The device use a Kinect camera to

capture the interaction;

a LCD monitor to projecting the 3-D

image;

a PC to process and control the

device;

a pyramidal structure where the

image is projected;

a external structure to support the

monitor and protect the pyramid;

How does it work?

DIYa digital fabrication

Visions Project K.

• This project has been

conceived like a low cost DIY

portable device;

• The structure is light and easy

of build and dismantle;

• all the information necessary

to create, build and how to make that work isshare by a Creative Commons License

Visions Project K.

Visions Project K.

OPEN DESIGN: Sketchup

The materials to build the

entire device are:

8 plastic tubes (45 cm).

4 plastic tubes (20 cm).

4 plastic triangles to build the

pyramid

4 corners to support the

pyramid and the structure.

4 corners to support the

monitor.

DIYDIGITAL FABRICATION

Visions Project K.

The elements of the structure are

printing by a Makerbot machine

(OpenFab, Medialab-Prado)

You can download Sketchup 3-D

model

http://sketchup.google.com/3dwarehouse/d

etails?mid=f20afc7c51f36aace20f58bc12c

e37ce

HardwareKinect sensor

Visions Project K.

Hardware:

Visions Project K.

LCD Monitor CPU:

Linux

Mac

Windows

3D sensor

(Kinect)

Hardware:

Visions Project K.

Kinect

IR pattern proyection

Láser IR

CMOS RGB CMOS IR

Motor

MicrophoneMicrophone

Hardware:

Visions Project K.

Kinect applications

1. 3D Scene

2. RGB Image

3.Body and objects recognition

4.Gesture Recognition

5.Voice command recognition

6.Tilt control

FLOSS

Visions Project K.

HACKING KINECT by

Software: Processing in multiplatform

• The device use a Kinect camera, in order to visualize people in 3-D

space; It use an open source drivers

• The OpenNI framework provides a set of open source APIs. These APIs are intended to become a standard for applications to access natural interaction devices.

• The APIs provide support for Voice and voice command recognition; Hand gestures; Body; Motion Tracking

• The software was developed with the OpenNI library for

Processing;

Visions Project K.

Software:

Visions Project K.

Open Libraries

1.OpenKinect Processing, others

2.SimpleOpenNIProcessing

3.dLibsProcessing

4.OfxKinectOpenFrameworks

5.Kinect Cinder Block C/C++

Software:

Visions Project K.

OpenKinect

Point Cloud

Software:

Visions Project K.

OpenKinect

Average Point Tracking

Software:

Visions Project K.

OpenKinect

1.Easy to install

2.Multiplataform

3.Easy to use

Advantage Disadvantages1.No recognition

2.No Alignment

Software:

Visions Project K.

SimpleOpenNI

Hands

Software:

Visions Project K.

SimpleOpenNI

Gestures

VLAB4D development

Visions Project K.

Processing

OpenKinect

SimpleOpenNI

3D Video for VP

háptic interaction

for VP

Telepresence for

VP

Visions Project K.

Single projection/videohologram

3D projection/Point Cloud

Visions Project K.

3D Reconstruction/ Full Color

Visions Project K.

Haptic interaction

Futures possibilities

Visions Project K.

1. Increasing the number of applications

2. Mini version for Tablet Pc, Ipad, etc..

3.Use as scientific display (biology,

arquitecture, engineering..etc..)

Visions Project K.

THANKS

http://vlab4d.wix.com

http://visionlab4d.com.ar

francesca@visionlab4d.com.ar

desarrollo@visionlab4d.com.ar

Visions Project K.