Cochlear Implant

CSE 60641 Microsoft Kinect PerformanceSlide 1/7Aaron Huus Ben Bockstege

Microsoft Kinect Performance MetricsCSE 60641 Graduate Operating Systems Progress Report Presentation11/1/2011

Talk about Kinect Tech:Kinect is an advanced camerahas 3d Depth SensorSimilar to eyesRGB cameraMulti-Array Microphone

Describe skeleton trackingUser detection

1CSE 60641 Microsoft Kinect PerformanceSlide 2/7Aaron Huus Ben Bockstege

Project OverviewPurposeViability for WiiHabilitaitonHardware RequirementsFPS fast enough not to lose dataWrite to disk speed based on OSIf there is a bottleneck, where does it exist?Does frame size change?

Libraries and drivers from PrimeSenseOpenNI NITE PrimeSensorOperating SystemsWindows 7 Ubuntu 11.10Mac OS X 10.6

Will the Kinect miss user motions because FPS is too slow?

Drivers chosen to try and make sure they are not restricted by the hardware or OS they are using

WiiHabilitation is an attempt to use the Wii and ideally the Kinect to aide stroke patients during rehabilitation. These should provide feedback to a therapist to help with patient balance.

Kinect will be useful to quantify various attributes throught the rehabillitation session such as posture during a sit to stand exercise.

Bottleneck relating to shannons law.

2CSE 60641 Microsoft Kinect PerformanceSlide 3/7Aaron Huus Ben Bockstege

Demonstration

CSE 60641 Microsoft Kinect PerformanceSlide 4/7Aaron Huus Ben Bockstege

Current Progress Running on Windows 7 and UbuntuObserved factors affecting the frame rateDisplay15 FPS with display on30 FPS with display off

User presence 15.5 FPS to 15.35 FPS User movement15.35 FPS to 15.20 FPSObject noise20 FPS with no noise14 FPS with lots of noise

OBSERVED FACTORS:Display : FPS noticeably higher when the data was not output to the screenUser presence: FPS drops initially and then rebounds to a value slightly lower than baseline. # of users also slightly decreases the FPSUser movement: FPS only had a minor effectObject noise:If the camera is covered, the FPS increases significantly (~15 to 20)4CSE 60641 Microsoft Kinect PerformanceSlide 5/7Aaron Huus Ben Bockstege

Results of Observed FactorsUser EntersSkeleton FoundMovementUser LeavesOBSERVED FACTORS:Display : FPS noticeably higher when the data was not output to the screenUser presence: FPS drops initially and then rebounds to a value slightly lower than baseline. # of users also slightly decreases the FPSUser movement: FPS only had a minor effectObject noise:If the camera is covered, the FPS increases significantly (~15 to 20)5CSE 60641 Microsoft Kinect PerformanceSlide 6/7Aaron Huus Ben Bockstege

Future WorkOperational on Mac OS XNeed root access to install necessary libraries/driversWrite to disk speedApproach similar to FPSAverage frame sizeDoes this vary based on experiment?

ExperimentsSkeleton trackingMore than one userMore user movementColor contrastSkin color, clothing colorQuantify experimental resultsPlots comparing FPS and write to disk speed across all 3 OSMore than one user, if the therapist is close to the patient during the trialColor contrast: White/pastel colors similar to the ones found in a hospital.6CSE 60641 Microsoft Kinect PerformanceSlide 7/7Aaron Huus Ben Bockstege

Questions?More than one user, if the therapist is close to the patient during the trialColor contrast: White/pastel colors similar to the ones found in a hospital.7