43

Blue Eyes Ppt

  • Upload
    krishna

  • View
    35.041

  • Download
    16

Embed Size (px)

DESCRIPTION

This ppt is abt how the blue eye technology works

Citation preview

Page 1: Blue Eyes Ppt
Page 2: Blue Eyes Ppt

Blue eye technology

( blue eyes –Human operator

monitoring system )

BY

Page 3: Blue Eyes Ppt

Agenda

Motivation What is BlueEye technology ? What is BlueEyes ? System designing System overview DAU CSU Data security IBM research Conclusion

Page 4: Blue Eyes Ppt

Motivation Human error - a frequent reason of

catastrophes and ecological disasters

• Lack of complex solution exploiting wireless link technology, database systems and AI algorithms

– temporal indisposition

– weariness – oversight

• Monitoring of consciousbrain involvement

• Capable sensors available

Page 5: Blue Eyes Ppt

What is blue eye technology ? The BLUE EYES technology

aims at creating computational machines that have perceptual and sensory ability like those of human beings.

 

Page 6: Blue Eyes Ppt

How can we make computers “see” and “feel” ? Blue eyes uses sensing technology to

identify a user’s actions and to extract key information.

Information is then analyzed to determine the user’s physical ,emotional ,or informational state.

Page 7: Blue Eyes Ppt

What is BlueEyes ?

The complex solution for human-operator monitoring:– Visual attention monitoring– Physiological condition– Operator’s position detection– Wireless data acquisition using bluetooth– Real time user defined alarm triggering– Recorded data playback

Page 8: Blue Eyes Ppt

Doesn’t predict nor interfere with operator’s thoughts

Cannot force directly the operator to work

What is BlueEyes not?

Page 9: Blue Eyes Ppt

IBM research

BLUE EYE – EMOTIONAL MOUSE sensors in the mouse ,sense the

physiological attributes which are correlated to emotions using correlation model

-by simply touching the mouse ,the computer will be able to determine a person’s emotional state.

BLUE EYE enabled TELEVISION – could become active when the user makes an eye contact.

Page 10: Blue Eyes Ppt

Physiological foundations

Preconscious brain• manages the knowledge • logical reasoning• makes decisions

• alogical• „automatic”

Conscious brain

Human brain

Page 11: Blue Eyes Ppt

Conscious brain - operation modes

Exploratory mode Planning mode

Page 12: Blue Eyes Ppt

The eye movement sensor Off-shelf eye movement sensor – Jazz

multisensor Supplies raw digital data regarding- Eye position- Level of blood oxygenation- Acceleration along horizontal and

vertical axes- Ambient light intensity

Page 13: Blue Eyes Ppt

Eye movements

Saccade - a rapid eye jump to a new location assigned by the conscious attention process.

Saccades presence - Exploratory mode

• Central vision andthe conscious brain

• Retina - central vision (macula)

Page 14: Blue Eyes Ppt

Jazz multisensor

Jazz Multisensor

Page 15: Blue Eyes Ppt

Jazz

Page 16: Blue Eyes Ppt

• A reliable real-time buffering, processing and recording

• A clear visualization interface• Mechanisms for creating custom data

analyzers• To ensure a possibility of distributing the

processing among a number of computers

Design objectives A mobile data acquisition device

Page 17: Blue Eyes Ppt

Implementation and engineering considerations-THREE groups of users OPERATOR -a person whose physiological parameters are

supervised - authorization in the system - receiving alerts SUPERVISOR – a person responsible for analyzing operator’s condition and performance. SYSTEM ADMINISTRATORS- maintains the system deliver tools for adding - new operator’s to the database - defining alarm conditions - configuring logging tools - creating new analyzer modules

Page 18: Blue Eyes Ppt

Designing

A personal area network for linking all the operators and the supervising system

Two major units - DAU (data acquisition unit )- CSU (central system unit )

Page 19: Blue Eyes Ppt

System overview

Central System UnitData Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

ConnectionManager

Data Analysis

VisualizationModuleBluetooth Bluetooth

Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system.

DataLogger

Page 20: Blue Eyes Ppt

DAU

The DAU consists of the following components ATMEL 8952 microcontroller BLUE TOOTH MODULE – supports synchronous voice

data transmission PCM CODEC –used to transmit operator’s voice and

central system sound feedback UART –communication between bluetooth module and

microcontroller (115200 bps) MAX232 –level shifter ALPHAUNUMERIC LCD display LED indicators ID CARD interface

Page 21: Blue Eyes Ppt

DAU - features

Lightweight Runs on batteries -

low power consumption

Easy to use - does not disturb the operator working

ID cards for operator authorization

Voice transmission using hardware PCM codec

Data Acquisition Unit

Atmel 89C52microcontroller

JazzMultisensor

Bluetooth

is

Page 22: Blue Eyes Ppt

BlueEyesData Acquisition Unit

ID card

DAU - components

MC 145483PCM codec

ID cardinterface

Simplekeyboard

Jazz Multisensor

Beeper

LCD display

LED indicators

Atmel 89C52microcontroller

UART MAX232

UA

RT

Bluetoothmodule

microphone

earphone

Page 23: Blue Eyes Ppt

Microcontroller & blue tooth module

Page 24: Blue Eyes Ppt

EEPROMS & the PCB

Page 25: Blue Eyes Ppt

Implementation - DAU

Bluetooth module inside Jazz sensor

interface Microphone and

earphone sockets 5-key keyboard Two lines, 8

characters LCD Powered from

6 AA batteries

n• Made from scratch by the team

Page 26: Blue Eyes Ppt

Implementation - DAU

Bluetooth module

PCM codec board

Batteries andvoltage level monitor

Microcontroller board

Page 27: Blue Eyes Ppt

CSU - featuresCentral System Unit

ConnectionManager

Data Analysis

VisualizationModuleBluetooth

Connection management

Data processing

Visualization Data recording Access

verification System maintenance

ConnectionManager

DataLogger

Page 28: Blue Eyes Ppt

CSU – components

CONNECTION MANAGER – main task to perform low-level blue tooth communication

DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in order to obtain information about operator’s physiological condition

DATA LOGGER MODULE – provides support for storing the monitored data.

VISULAIZATION MODULE – provides user interface for the supervisors

Page 29: Blue Eyes Ppt

CSU - Visualization Module

Raw and processed data visualization using:

audio and videodata playback

– VU-meters– pie-charts– time series

Page 30: Blue Eyes Ppt

CSU - saccade detector Saccade detector and conscious brain

involvement level calculationEye movement velocity

-250-200-150-100

-500

50100150200250

0 8000 16000 24000 32000Time [ms]

Ve

locit

y

saccadeRaw eyemovement data

Differentiation

Conscious brain involvement level

Visual attention level

0

10

20

30

40

50

60

0 8000 16000 24000 32000

Time [ms]

Att

en

tio

n le

ve

l (L

va

)

Page 31: Blue Eyes Ppt

• Initializes Bluetooth modules

• Inquires for new devices in range

• Establishes connections • Supports operator

roaming• Feeds Operator Manager

with physiological data

Bluetooth

Bluetooth

...

...

CSU - Connection Manager

BluetoothConnection

Manager

OperatorData

Manager

Alerts

Separateddata streams

...

...

OperatorManager

Alert buffer

Raw DataBuffer

Alerts

OperatorManager

Alert buffer

Raw DataBuffer

• Data demultiplexer• Data producer queues

Page 32: Blue Eyes Ppt

CSU - Data Analysis• Custom data analyzers - decision tree based classifiers

• Automatic decision tree coefficients generation - C4.5 based algorithm

Data samplesAssignedcategory

“Yes”

No answer

“Yes”

“No”

No answer

... ... Decision tree coefficients

Page 33: Blue Eyes Ppt

CSU - Data Analysis Custom data analyzers - decision tree

based classifiers

Example: Operator gesture recognition(simplified)

Vertical Acceleration variance value high

Horizontal Acceleration variance high

Horizontal Acceleration variance high

Y N

Y N YN

No answer “NO”“YES”

Page 34: Blue Eyes Ppt

CSU - intermodule communication

Uses buffered thread-safe queues and producer-consumer scheme

Dataproducer

Dataqueue

Dataconsumer

Dataconsumer

creates

Dataconsumer

Processing

Processing

Dataconsumer &

producer

Dataconsumer &

producer

Dataqueue

Dataqueue

register at

Dataconsumer

Page 35: Blue Eyes Ppt

CSU - intermodule communication

Data AnalysisVisualization

ModuleData

Logger

Operator manager (OM) OM OM

ConnectionManager

...

Separated physiological data streams

Processed data

Alerts

Recorded (off-line) data

Data AnalysisVisualization

Module

Operator manager (OM) OM OM

ConnectionManager

...

Page 36: Blue Eyes Ppt

Implementation - CSU

Custom-builtBluetoothcommunicationroutines

Intel USB camera ID card programmer Developed using Visual C++ 6.0 Deployment environment:

Windows 2000,MS SQL Server

• Standard MDI userinterface

Page 37: Blue Eyes Ppt

Future improvements

DAUsmall CMOS camera to monitor the operator’s point of gazesingle PCB (SMD technology)low voltage ICs - LiIO batteries power

CSUdata mining algorithms advanced database encryption using e.g. AES algorithm

Page 38: Blue Eyes Ppt

Data security

Only registered mobile devicescan connect to the system

Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions Personal and physiological data

encryption

Page 39: Blue Eyes Ppt

Applications of BlueEyes Generic control rooms(System can be applied in every working

environment requiring permanent operator’s attention)

– Power station– Captain bridge– Flight control centers– Operating theatres – anesthesiologists

Common application– A simpler system version for drivers

Page 40: Blue Eyes Ppt

Blue Eyes - benefits

Prevention from dangerous incidents

Minimization of– ecological consequences– financial loss– a threat to a human life

The reconstructionof the course ofoperator’s work

Page 41: Blue Eyes Ppt

References

www.seminar4u.com www.howstuffswork.com www.cs.put.poznan.com www.whitepapers.com www.ibmresearchcenter.com www.almaden.ibm.com

Page 42: Blue Eyes Ppt

Conclusion

In the near future ,ordinary household devices- such as television , refrigerators ,ovens may be able to do their jobs when we look at them and speak to them.

Future applications of blue eye technology is limitless

Page 43: Blue Eyes Ppt

Thank you