35

ISSN 2348-7852 (Print) | ISSN 2348-7860 (Online) ijre.org

IJRE | Vol. 03 No. 04 | April 2016

An Implementation of Gesture Recognition Smart home technology using Android and

Matlab Author(s): Sruthi A.C.G, M.Janarthanan M.E

Department of Electronics & Communication Engineering

SRM University, Chennai, India – 60089

Abstract- In this world where today’s home require

sophistication every operations are performed by human

are getting simple in order to make it more simpler we

have introduced a new innovation for physically

handicapped and for normal people. I present an

innovation which has three modes. The current home

automation systems either concentrate normal people or

handicapped people. The first mode uses a smart phone

with Bluetooth connection that has an application and the

second mode is specifically designed for physically

handicapped especially whose hand movements are

captured for controlling home appliances and the third

mode is hand gloves wireless system. This system design

will cover both the hardware implementation and software

interface of the wireless system. The biggest advantage of

the system is that it can be used for handicapped and

normal people thus reducing the cost of installation of

three different home automation systems.

Keywords- Bluetooth, Hand gesture, Sensors, System for

physically handicapped, system for blind, Wireless

communication, Home automation.

I. INTRODUCTION

Now a day’s technological revolution has given us a

powerful tool to control our surrounding. We recognise this

tool to control appliances in home. Home automation

industry has drawn considerable attention of the researchers

for more than a decade [1].The main idea is to automatically

control and monitor electrical and electronic home

appliances [5]. A home automation technique based on

ARM Controller uses an IR sensor to detect the person.

Android application is used to control the electrical

appliances [1].Due to the physical limitation, handicapped

people cannot use home appliances well. In order to furnish

them convenient life, home automation system for

physically handicapped people should be developed [2].

Recently, there has been a surge in interest in recognizing

human hand gestures. Hand gesture recognition has various

applications like computer games, machinery control (e.g.

crane), and thorough mouse replacement [4].Blind people

need some self assistance in carrying out some basic

activities at home. A blind person feels difficult in

controlling the home appliances. The recent technologies

contribute a sophisticated life for the blind people [3]. These

systems target a very different set of applications such as

hand gesture and Bluetooth. Bluetooth have very different

capabilities than other WPANS and WLANS.

II. BACKGROUND

Today everything can be operated using Smartphone

just in one touch using this concept we have introduced a

system to control home appliances using Bluetooth, hand

gesture recognition and hand gloves wireless system the

home appliances can be controlled with ease for normal and

physically handicapped people. Bluetooth is one of the new

technologies designed to enable wireless home automation

system.

A. BLUETOOTH

Bluetooth a wireless technology used for exchanging data

over short distances which uses short-wavelength UHF radio

waves from 2.4 to 2.485 GHz from fixed and

mobile devices, and building personal area networks. The

data transmission distance is small in comparison with other

modes of wireless communication. This technology avoids

the use of cords, adapters and allows the electronic devices

to communicate wirelessly with each other. The important

features of this technology are less complication, consumes

less power, less cost, Robust. The device transmits with a

range of approximately 32 feet or 10 metres. HC-05 module

is an easy to use Bluetooth module, designed for transparent

wireless serial connection setup.

B. MICROCONTROLLER ATMEGA8

Atmel 8-bit AVR RISC- is a high performance

microcontroller. The ATmega8 provides the following

features:

1. 1.4K/8Kbytes of In-System Programmable Flash

memory with Read-While-Write capabilities

2. 256/512/512/1Kbytes EEPROM

3. 512/1K/1K/2Kbytes SRAM

4. 23 general purpose I/O lines

5. 32 general purpose working registers

6. three flexible Timer/Counters with compare modes

7. internal and external interrupts

8. a serial programmable USART,

9. A byte-oriented 2-wire Serial Interface.

10. A 6-channel 10-bit ADC.

11. A programmable Watchdog Timer with internal

Oscillator

12. Five software selectable power saving modes.

There are 28 pins, 3 ports PORT A, B and C. Total of

13 input/output digital pins , 7 analog input Pins. Other pins

are 2-VCC, 2-GND, 1-AREF, 2-XTAL; 1-RESET.Each

register has 8 BITS. It has 6 PWM pins which vary between

0-255.The AVR core combines a rich instruction set with 32

general purpose working registers. All the 32 registers are

directly connected to the Arithmetic Logic Unit allowing

two independent registers to be accessed in one single

instruction executed in one clock cycle.

36

ISSN 2348-7852 (Print) | ISSN 2348-7860 (Online) ijre.org

IJRE | Vol. 03 No. 04 | April 2016

Figure 2.Pin diagram Atmega8 microcontroller.

C. APP INVENTOR

App Inventor is an open-source web application for android

originally developed by Google, and now under the

maintenance of Massachusetts Institute of Technology

(MIT). App Inventor is used to create a GUI application for

our system. This application is used for creating the user

interface for android smart phone based home automation

module.

Figure 3.App Inventor

Figure 4.App inventor user interface

D. ANDROID SYSTEM

Android is an operating system (OS) for mobile devices

which is currently developed by Google. It was designed

primarily for touch screen mobiles such as smart

phones and tablets. Android's user interface is based

on touch gestures. we use Android application as the user

interface for controlling the home appliances.

E. MAT LAB

MATLAB (matrix laboratory) is a numerical

environment used for computing and it is known as the

fourth-generation programming language. It was a

programming language developed by Math Works,

MATLAB allows matrix manipulations, plotting

of functions and data, algorithm implementation, user

interface creation, and programs written in other languages

including C, C++, Java, Fortran and Python can be

interfaced with MATLAB.

F. ARDUINO

Arduino is a tool that makes computers sense and

control more of the physical world than our desktop

computer. It's an open-source physical computing platform

which has a simple microcontroller board, with a

development environment for writing software for the board.

Arduino is used to develop interactive objects; it is used to

take inputs from a variety of switches or sensors, and is

helped in controlling a variety of lights, motors, and other

physical outputs. Arduino projects are stand-alone projects

which can communicate with software running on our

computer. The boards can be assembled by hand or

purchased preassembled; the open-source IDE can be

downloaded.

Arduino simplifies the process of working with

microcontrollers. The features of arduino are it is

1. Inexpensive

2. Cross-platform

3. Simple, clear programming environment

The Arduino is based on Atmel's ATMEGA8

microcontrollers.

G. CAMERA AND SENSORS

Camera - A webcam is a video camera that inputs its image

in real time to or from a computer. When "captured" by the

computer, the video stream may be saved, can be viewed or

sent on to other networks using systems such as the internet,

and can be sent as an email attachment. A webcam is

connected by a USB cable or built into computer hardware,

such as laptops.

Sensors- We use different sensors to control home

appliances they are 1.PIR sensors 2.Temperature sensor 3.

Light sensor 4.Gas sensor 5. Float sensor

PIR Sensor - A passive infrared sensor (PIR sensor) is an

electronic sensor that measures infrared (IR) light that

radiates from objects in its field of view. They are most

often used in PIR-based motion detectors.

Temperature Sensor – A temperature sensor is a device

for temperature measurement through an electrical signal. It

is used to check the room temperature and accordingly

control the home appliances

Gas Sensor- A gas detector is a device that is used in

detecting the presence of gases in an area which is used

often as part of a safety system. This equipment is used to

37

ISSN 2348-7852 (Print) | ISSN 2348-7860 (Online) ijre.org

IJRE | Vol. 03 No. 04 | April 2016

detect a gas leak which interface with a control system so a

process can be shut down automatically. A gas detector can

sound an alarm to operators in the area where the leak

occurs, giving them the opportunity to leave.

Light Sensor - A light sensor is an electronic device used to

detect light. There are several types of light sensors. A

photocell or photo resistor is a sensor which changes its

resistance when light shines on it.

III. BASIC AND FUNCTIONAL BLOCK

DIAGRAM

Basic Block Diagram of system is as shown in

Figure 5. According to Figure 5, the hardware part is mainly

based on ATMEGA8 microcontroller unit, Bluetooth is used

as a transceiver to receive and send information. In the first

mode Bluetooth mode the software is used as an interface.

The information from software is sent to Bluetooth and the

information is passed to the Atmega8 Micro controller and

accordingly home appliances get controlled by using driver

circuit. The microcontroller is connected with Relay to

control the lights and Fan. It uses a float sensor to indicate

the water level in the over head tank. If the water is below

the level indicated in the application then the motor driver is

used to pump the water. The second mode will be able to

detect several hand gestures which pass the information to

the microcontroller and the controller process the

information.

Figure 5 Block diagram of system

In the second mode Mat lab interface is used for

the Hand Gesture control where the hand movement is

captured using a webcam and is processed using Mat lab.

The Gesture interactive system is one kind of nature user

interface that provides human a convenient remote control

environment according to hand and finger. The gesture

system is suitable for physically handicapped people,

especially for feet handicapped people. The interactive

system not only tracks the hand gesture but also detects

finger click function. The gesture control system uses a Mat

lab interface which is connected with the Atmega8

microcontroller and thus the home appliances can be

controlled. In the third mode Hand gloves wireless system is

used from which the information is passed to

microcontroller using Bluetooth that is fixed in hand glove

that which controls the home appliances.

IV. FURTHER ENHANCEMENT

Further enhancement can be done such that the automation

system can be installed to automate electric appliances in

streets, schools and educational institution, companies.

V. ACKNOWLEDGMENT

The author is very grateful to the HOD M.JAGADESAN

M.E, Ph.D, and Internal guide M.JANARTHANAN M.E

and other authors, who has provided valuable guidance,

ideas and encouragement for successful completion of this

project.

VI. CONCLUSION

In this paper, a home automation system based on a

Bluetooth wireless technology and Hand gesture recognition

and hand glove wireless system is proposed. The usefulness

of the proposed method is proven through experiments using

the developed module.

VII. REFERENCES

1. Android Mobile Based Home Security and Device

Control Using GSM; IEEE Sponsored 2nd International

Conference on Innovations in Information, Embedded

and Communication systems (ICIIECS) 2015.

2. Three-Dimensional Gesture Interactive System Design

of Home Automation for Physically Handicapped

PeopleYu-Cheng Fan, IEEE Senior Member National

Taipei University of Technology Taipei, Taiwan.

3. Hand gesture based home automation for visually

challenged International journal of innovations in

engineering research and technology [ijiert]Issn: 2394-

3696Volume 2, issue 4, apr.-2015

4. Hand Gesture Recognition Using Neural Network

5. Zigbee technology and its application in wireless home

automation systems: A SURVEY thoraya obaid,

haleemahrashed, ali abou-elnour, muhammad rehan,

mussab muhammad saleh, and mohammed tarique .

International Journal of Computer Networks &

Communications (IJCNC) Vol.6, No.4, July 2014.