Using Kinect (2) by Edi

@agatestudio

Using Kinect for games

Maret, 2014

@agatestudio @agatestudio @agatestudio

Overview

• Kinect?

• Features

• How Kinect Works

• Using Kinect for Games

• Demo

@agatestudio @agatestudio @agatestudio

Kinect?

• Motion sensing device

• November 2010 – XBOX

• February 2012 – SDK for Windows

@agatestudio @agatestudio @agatestudio

Features

• Natural User Interface (NUI)

– Video input

– Audio input

• Kinect Fusion (object scanning and modelling)

@agatestudio @agatestudio @agatestudio

How Kinect Works

@agatestudio @agatestudio @agatestudio

How Kinect Works

• Compute Depth (using depth sensors)

– Structued Light Technique

– Stereo Images

• Get Body (and parts) data

– Machine Learning

– Get body parts from depth image

– Transform to skeleton

@agatestudio @agatestudio @agatestudio

How Kinect Works

Speckle-Pattern Infrared Light

@agatestudio @agatestudio @agatestudio

How Kinect Works

Speckle-Pattern Infrared Light

@agatestudio @agatestudio @agatestudio

How Kinect Works

Stereo Image (calculating depth with Parallax images)

@agatestudio @agatestudio @agatestudio

How Kinect Works

@agatestudio @agatestudio @agatestudio

Using Kinect

@agatestudio @agatestudio @agatestudio

Using Kinect For Games

@agatestudio @agatestudio @agatestudio

Using Kinect for Games

What you need :

• Kinect sensor device

• Kinect SDK

• Open area – One player: Stand back 6 feet (1.8 m).

– Two players: Stand back 8 feet (2.4 m).

– Make sure that the play space is at least 6 feet (1.8 m) wide, and not wider or longer than 12 feet (3.6 m).

@agatestudio @agatestudio @agatestudio

Using Kinect for Games

• Kinect SDK

– Microsoft SDK (Official for kinect)

– Open Source SDK (For other motion sensing devices : PrimeSense, Asus Xtion, etc) : OpenNI

@agatestudio @agatestudio @agatestudio

Using Kinect for Games

Official SDK supports only C, C++, and Visual Basic (Microsfot based)

Wrappers :

- AIR : AS3Kinect, as3NUI

- Unity : ZDK

- etc

@agatestudio @agatestudio @agatestudio

Using Kinect for Games

Example (using ZDK for unity)

@agatestudio @agatestudio @agatestudio

References

• http://gilotopia.blogspot.com/2010/11/how-does-

kinect-really-work.html • http://users.dickinson.edu/~jmac/selected-

talks/kinect.pdf • http://courses.engr.illinois.edu/cs498dh/fa2011/lectures

/Lecture%2025%20-%20How%20the%20Kinect%20Works%20-%20CP%20Fall%202011.pdf

• http://www.wisegeek.com/how-does-kinect-technology-work.htm

• http://msdn.microsoft.com/en-us/library/jj131023.aspx

@agatestudio @agatestudio @agatestudio

Demo