Upload
geethu-shaji
View
225
Download
0
Embed Size (px)
Citation preview
8/8/2019 28704893 Sixth Sense Ppt
1/29
Page 1
SIXTH SENSE: A WEARABLE
GESTURAL INTERFACE
Prepared by,
GEETHU SHAJI
ROLL NO:22
8/8/2019 28704893 Sixth Sense Ppt
2/29
Introduction
Components
Working
Technique behindApplications
CONTENTS
8/8/2019 28704893 Sixth Sense Ppt
3/29
INTRODUCTION
Sixth Sense is a wearable gestural interface that augments the physical
world around us with digital information and lets us use natural hand
gestures to interact with that information.
It was developed by Pranav Mistry, a PhD student in the Fluid Interfaces
Group at the MIT Media Lab.
SixthSensebridges the gapby bringing intangible, digital information out
into the tangible world, and allowing us to interact with this information via
natural hand
SixthSense comprises apocket projector, a mirror and a camera. The
hardware components are coupled in a pendant like mobile wearable device
8/8/2019 28704893 Sixth Sense Ppt
4/29
WHY SIXTH SENSE?
8/8/2019 28704893 Sixth Sense Ppt
5/29
Camera
Mobile Component
Projector
Mirror
Colored Markers
COMPONENTS
The hardware components are coupled in a pendant like mobile wearable
device.
8/8/2019 28704893 Sixth Sense Ppt
6/29
Camera
Captures an object in view and tracks the users hand gestures
It sends the data to smart phone
It acts as a digital eye, connecting you to the world of digital information
8/8/2019 28704893 Sixth Sense Ppt
7/29
Smart Phone
A Web-enabled smart phone in the users pocket processes the video
data
Other software searches the Web and interprets the hand gestures
It always keep us connected to the digital world
8/8/2019 28704893 Sixth Sense Ppt
8/29
Projector
The projectorprojects visual information enabling surfaces and physical
objects to be used as interfaces
The project itself contains abattery inside, with 3 hours of battery life.
A tiny LED projector displays data sent from the smart phone on any
surface in viewobject, wall, or person.
8/8/2019 28704893 Sixth Sense Ppt
9/29
Mirror
The usage of the mirror is significant as the projector dangles pointing
downwards from the neck.
MIRROR
8/8/2019 28704893 Sixth Sense Ppt
10/29
Color Markers
It is at the tip of the users fingers .
Marking the users fingers with red, yellow, green, and blue tape helps the
webcam recognize gestures
The movements and arrangements of these makers are interpreted into
gestures that act as interaction instructions for the projected application
interfaces.
8/8/2019 28704893 Sixth Sense Ppt
11/29
HOW IT WORKS?
Images
Pictures
Gestures
Info on
surface
captureSend for
processing
Reflect on
desired surfaceProject image
Send Info
8/8/2019 28704893 Sixth Sense Ppt
12/29
The hardware that makes Sixth Sense work is a pendant like mobile
wearable interface
It has a camera, a mirror and a projector and is connected wirelessly to a
bluetooth smart phone that can slip comfortably into ones pocket
The camera recognizes individuals, images, pictures, gestures one makes
with their hands
Information is sent to the Smartphone forprocessing
The downward-facing projectorprojects the output image on to the mirror
Mirrorreflects image on to the desired surface
Thus, digital information is freed from its confines and placed in the
physical world
Cont
8/8/2019 28704893 Sixth Sense Ppt
13/29
TECHNIQUE BEHIND
The main technique behind this sixth sense technology is the
COMPUTER VISION TECHNIQUE.
Its mainly an algorithm which is written in the language zimbian c++.
The processing of this algorithm takes place inside the smart phone.
8/8/2019 28704893 Sixth Sense Ppt
14/29
COMPUTER VISION TECHNIQUE
It is the science and technology of machines that see.
Theory behind artificial systems that extract information from images.
It produces or recognizes 3D models from images.
Users intentional hand gestures are captured by camera, interpreted
and used to control an application.
8/8/2019 28704893 Sixth Sense Ppt
15/29
Page 15
SEGMENTATION
It consist of two steps,
1) DETECTION
.single camera system is used for detection.
.camera orientation and background color has considerable
importance.
.RGB format is used to differentiate objects using color.
.calibration technique using here is initial calibration.
8/8/2019 28704893 Sixth Sense Ppt
16/29
2) RECOGNITION
.The method used for recognition here is learning method.
.In learning method the gesture set to be recognized is taught to thesystem before.
.The comparison method used here is radial length signature.
8/8/2019 28704893 Sixth Sense Ppt
17/29
Take pictures
If you fashion your index fingers
and thumbs into a square
("framing" gesture), the system
will snap a photo.
After taking the desired number of
photos, we can project them onto a
surface, and use gestures to sortthrough the photos, and organize
and resize them.
8/8/2019 28704893 Sixth Sense Ppt
18/29
APPLICATIONS
8/8/2019 28704893 Sixth Sense Ppt
19/29
Check the time
Draw a circle on your wrist to get a virtual
watch that gives you the correct time
Make a call
You can use the Sixth Sense to project a
keypad onto your hand, then use that
virtual keypad to make a call.
8/8/2019 28704893 Sixth Sense Ppt
20/29
Create multimedia reading
experiences
Sixth Sense can be programmed to project related
videos onto newspaper articles you are reading
8/8/2019 28704893 Sixth Sense Ppt
21/29
Drawing application
The drawing application lets the user draw
on any surface by tracking the fingertip
movements of the users index finger
Zooming features
The user can zoom in or zoom out using
intuitive hand movements
8/8/2019 28704893 Sixth Sense Ppt
22/29
Get product information
Sixth Sense uses image recognition ormarker technology to recognize products
we pick up, then feeds us information on
those products
Get book information
The system can project Amazon ratings on
that book, as well as reviews and otherrelevant information
8/8/2019 28704893 Sixth Sense Ppt
23/29
Get flight updates
The system will recognize your boarding
pass and let you know whether your flight
is on time and if the gate has changed.
Feed information on people
The system will project relevant informationabout a person such as what they do, where they
work, and so on.
8/8/2019 28704893 Sixth Sense Ppt
24/29
Take pictures
If you fashion your index fingers
and thumbs into a square
("framing" gesture), the system
will snap a photo.
After taking the desired number of
photos, we can project them onto a
surface, and use gestures to sortthrough the photos, and organize
and resize them.
8/8/2019 28704893 Sixth Sense Ppt
25/29
ADVANTAGES
Supports multi-user interaction
Portable
Connectedness betweenworld and information
Cost effective
Data access directlyfrom machine inrealtime
Mind mapthe idea anywhere
Itis anopensource
8/8/2019 28704893 Sixth Sense Ppt
26/29
DISADVANTAGES
Hardware limitations of the devices that we currently carry aroundwith us.
Complicated algorithms are used for the recognition of hand gestures.
8/8/2019 28704893 Sixth Sense Ppt
27/29
Sixth Sense recognizes the objects around us, displaying information
automatically and letting us to access it in any way we need
The Sixth Sense prototype implements several applications that demonstrate the
usefulness, viability and flexibility of the system
Allowing us to interact with this information via natural hand gestures
The potential of becoming the ultimate "transparent" user interface for
accessing information about everything around us
CONCLUSION
8/8/2019 28704893 Sixth Sense Ppt
28/29
http://boingboing.net/2009/11/12/sixth-sense-technolo.html
http://gizmodo.com/5167790/sixth-sense-technology-may-change-how-we-look-
at-the-world-forever
http://www.ted.com/talks/pattie_maes_demos_the_sixth_sense.html
http://theviewspaper.net/sixth-sense-technology-will-revolutionize-the-world/
http://www.freshcreation.com/entry/sixth_sense_technology/
REFERENCES
8/8/2019 28704893 Sixth Sense Ppt
29/29
THANK YOU