Odessa .NET User Group - Kinect v2

Kinect v2

Дмитрий Миндра@dmytromindra

Что такое Кинект v2?

64Kbyte0.043MHz

Что же такое Kinect v2?

Kinect VS Kinect v2Feature K4W K4W v2

Color Camera 640x480 @30 fps 1920 x1080 @30 fps

Depth Camera 320 x 240 512 x 424

Infra-Red (Spreads Dots) Yes No

Infra-Red (TOF) No Yes

Infra-Red Spectrum ~827 - 850nm ~827-850nm

Max Depth Distance ~4.5M ~4.5M

Min Depth Distance 40cm in near mode 50cm – 1cm (near mode)*

Microphone Array 4 mics 4 channels 16bit 16kHz 4 mics 4Channels 32bit 16kHz IEEE Float

Kinect VS Kinect v2Feature K4W K4W v2

Horizontal Field Of View 57 degrees 70 degrees

Vertical Field of View 43 degrees 60 degrees

Tilt Motor Yes No

Body Joints 20 26

Skeletons Tracked 2 6

USB version 2 3.0

Supported OS Win 7, Win 8 Desktop Win 8

Price $299 $199

Types of Applications Desktop, x86, x64, JavaScript, Web Desktop, x86, x64, Win 8 Store, JavaScript, Web

Кинект – это новый способ взаимодействия!

Высокоуровневая архитектура

Kinect Drivers

Kinect Runtime

.NetAPI

.NetApps

Native API

Native Apps

WinRT API

Windows Store Apps

C#, VB, JS, C++/CX

Несколько приложений могут работать с одним сенсором одновременно !

Physical Kinect Sensor

The data sources

Audio, Speech,

Interactions

DepthInfrared

Body Body Masks

Color

512 x 424 array of pixels

30 fps

2 bytes per pixel– 16-bit IR intensity value

Ambient light removedFrom the same physical sensor as depth

InfraredFrameSource

• 512 x 424 array of depth pixels• 30 fps• Range: 0.5 - 4.5 meters• Each depth pixel is a 16-bit

distance in millimeters from the sensor’s focal plane

DepthFrameSource

1920 x 1080 array of color pixelsDifferent image sensor than depth30 fps

– Will maintain brightness and quality by dropping to 15 fps in low-light

ColorFrameSource

512 x 424 array of body indexes– -1: No body at this pixel– 0 to 5: Index of the corresponding body, as

tracked by the body source

30 fpsResolution is same as depth

BodyIndexFrameSource

• Frame data is a collection of Body objects each with 25 joints– Each joint has position in 3D space and an

orientation

• Up to six simultaneous bodies• 30fps• Hand State on 2 bodies• Lean

BodyFrameSource

• Data is audio samples captured over a specific interval of time

• Audio data is associated with an “audio beam”– A steerable “cone” of focus for audio– May be automatically or manually aimed

AudioFrameSource

Есть официальный плагин для Unity!

Время для Демонстрации!

• Activities, Appearance, Expression– EyeLeftClosed, EyeRightClosed, LookingAway, MouthMoved,

MouthOpen, WearingGlasses, Happy expression, Neutral expression

• Speech• HD Face• Unity• Fusion

Что еще есть в Кинекте ?

Купить кинект!Зайти на Dev Center – http://aka.ms/k4wdev

Больше информации на официальном сайте http://kinectforwindows.com

Скачать плагин для Юнити:http://www.microsoft.com/en-us/kinectforwindows/develop/downloads-docs.aspx

Фото разобранного Кинекта вы можете найти на https://www.ifixit.com/Teardown/Xbox+One+Kinect+Teardown/19725

Видео лекции:http://channel9.msdn.com/Events/Build/2014/2-532http://channel9.msdn.com/Events/Build/2014/2-514

С чего начать ?

Спасибо !