Controlling electrical appliances using human gesture

by,Rajaganapathy SVIT UNIVERSITY

Problem Definition

• Natural user interface is the medium of interaction between a user and the machine in the form of human gesture.

• Our project is to control the electrical appliances by the human gesture using kinect sensor.

• Gesture recognition is nothing but the detection of humans bodily notion and the behavior

• Here kinect is a motion-sensing devise developed by Microsoft for the Xbox video game console and the windows pcs.

• The Kinect contains two cameras, an infra-red projector and four microphones. So it enables the user to control and interact with the Xbox 360 without the need to touch a device or a pc.

System requirements

• Hardware requirements:• Kinect Xbox device• Windows 7 pc• Microcontroller with the relay• Software devices• Visual studio• HyperTerminal

Existing system

• Remotely monitor and adjust home lighting control status throughout the house while away from home using your iPhone.

• For this system we need a network all the time and the GPS facility to access the location. And if the battery of the phone drains, we can’t control remotely

Proposed System Architecture

• Three views of kinect

• Kinect skeleton tracing,

Architecture of our system

Module Description

The kinect sdk is stably designed to identify 20 of human joints as shown in the above picture.

the position of each joint is given as an offset from the kinect sensor as shown in the figureX is left-rightY is up-downZ is away from the sensor

• The electric devices are connected to the relay where the relay with four points(1,2,3,4 and 5) as shown in the fig

To accessories

relay

Ground

• The kinect uses the .NET code for process the application. The c# code connects the microcontroller through the interface called HyperTerminal.– Once the person enters the room. The kinect

tracks the skeleton and sends to the system.– Once both the input streamed gesture and the

user defined gesture matches the respected appliances will be switched on.

References.

• http://www.i-programmer.info/programming/hardware/2623-getting-started-with-microsoft-kinect-sdk.html

• http://www.xbox.com/en-IN/Kinect• http://www.microsoft.com/education/ww/

products/Pages/kinect.aspx