Om Nit Ouch

8/2/2019 Om Nit Ouch

1/25

Technical Seminar

T. Sai Manikantesh

08QC1A0421


2/25

Touch Screen

A touch screen is a computerdisplay screen & is also an inputdevice.

User interacts with computer by touching pictures or words on thescreen.

Here, the application through touch screen is operated only on thesystem or mobile. In the absence of system, application cannot be run.

This is the main reason why we created Omni- Touch where we canoperate an application anywhere.

Fig: Picture shows a touch screen example

Fig: Picture shows an Omni-touch example


3/25

Omni-Touch

Omni Touch, a wearable system that projects any multi-touch

interface onto everyday surfaces

A new prototype can transform a notebook into a notebookcomputer, a wall into an interactive display, and the palm of

your hand into a smart phone display.

The palm of the hand could be used as a phone keypad, or as atablet for jotting down notes.

Maps projected onto a wall could be panned and zoomed with thesame finger motions as a conventional multi touch screen.

Microsoft Research and Carnegie Mellon University havecreated a wearable projection system that turns pads ofpaper, walls or even a user's own hands into graphical,interactive surfaces.


4/25

Description

Before projection was possible only on screen and could be operatedon skin.

A new wearable projection system can turn any surface into an ad-hoc

interactive touch screen, from the palm of your hand to an entire wall.

Fig: picture depicting projection of the Omni-touch


5/25

What it contains?

Omni-touch is made up of Kinect sensor consisting ofPico projector and depth camera

This sensor should be worn on the shoulder as shown in

image below.

Fig: Picture shows a kinect sensor


6/25

Images of Kinect sensor


7/25

From left to right is an IR laser projector, RGB camera, andIR camera. Between the RGB camera and IR laser is simply agreen LED for status - it plays no role in the actual opticalsystem.

Fig: Picture shows the kinect sensor

Fig: Picture shows the processor of

the kinect sensor- PS 1080Sc


8/25

Fig: Picture shows the working of the kinect sensor


9/25


10/25


11/25

Fig: Picture the cell site of an object scanned by the camera


12/25

Role of Camera:

The camera acquires depth information about the scene byemitting a patterned beam of infrared light and using thereflections to calculate where surfaces are in the room.

So if any object like your hand or notebook makes a movement,the. change in movement is identified and measured according

to the movement made by it before making the movement.

Consider you move your hand, the camera identifies the changeand makes a measurement of the movement.

So, you need not consider any additional calibrationinstrument.


13/25

Using a depth-sensing camera, users fingermovements are tracked, allowing them to controlapplications by tapping or dragging their fingers, muchas they would with a touch screen.

The device also allows for user flexibility farbeyond the capability of your phone or tablet.

Omni Touch is also itself capable of intelligentlychoosing the best display setting, so the userdoesn't have to readjust with each new surface.

The screen is sensitive enough to use by existing

Microsoft touch recognition software, making itpossible to send a text by drawing characters one byone

In tests performed by the Microsoft, users havebeen able to punch in numbers into a keypad

projected onto their hands and write on a virtualnotepad on a table.


14/25


15/25

MultiTouch Finger Tracking

Finger segmentation


16/25

Finger click detection

figure: finger slice

Figure : finger is

hovering(left) andclicked(right)


17/25

Surface Segmentation and Tracking


18/25

Images of Live Examples


19/25

Test surfaces


20/25

Applications

to punch numbers into a calculator projected on theirpalms

zoom in on a map projected on the wall with a single finger

providing ways to integrate human senses with technology

allows the wearer to use their hands, arms and legs asgraphical, interactive surfaces

use as computer for - checking email or surfing or to chator to play

To listen music

To use as a mobile for calling a friend or play games


21/25

Advantages

It is flexible to any surface.

We can use it in any condition like even whilejogging or walking.

Through the kinect sensor we can scan theenvironment in a 2-dimensional way.


22/25

Disadvantage:

The main disadvantage is with the size of the kinectsensor. But, surely in the near future the size will bedecreased to the size of the match box.

Another disadvantage is the cost of the equipment


23/25

This presentation described and evaluated proof of conceptimplementation of omnitouch.

The dedicated touch surfaces can now move into theenvironment,in an adhoc fashion.

A user styudy of this technology showed that draggingperformance and touch accuracy approached the sensitivity ofconventional screens


24/25

References

Anandtech.com

Technicalreview.com

Wikipedia

YouTube

Omnitouchinternational.com


25/25

Documents

Om Nit Ouch