Blue eyes report

  • Published on

  • View

  • Download

Embed Size (px)


<p>BLUE EYES TECHNOLOGYB. Tech. Seminar Report</p> <p>BY</p> <p>MUNISH BANSAL (06429)</p> <p>DEPARTMENT OF ELECTRONICS &amp; COMMUNICATION ENGINEERING NATIONAL INSTITUTE OF TECHNOLOGY HAMIRPUR-177005, HP (INDIA) November, 2009</p> <p>BLUE EYES TECHNOLOGY</p> <p>A Seminar ReportSubmitted in partial fulfillment of the Requirement for the award of the degree Of Bachelor of Technology In ELECTRONICS &amp; COMMUNICATION ENGINEERING</p> <p>BY MUNISH BANSAL (06429)</p> <p>DEPARTMENT OF ELECTRONICS &amp; COMMUNICATION ENGINEERING NATIONAL INSTITUTE OF TECHNOLOGY HAMIRPUR-177005, HP (INDIA) November, 2009</p> <p>Abstract - Human error is still one of the most frequent causes of catastrophes and ecological disasters. The main reason is that the monitoring systems concern only the state of the processes whereas human contribution to the overall performance of the system is left unsupervised. Since the control instruments are automated to a large extent, a human operator becomes a passive observer of the supervised system, which results in weariness and vigilance drop. This, he may not notice important changes of indications causing financial or ecological consequences and a threat to human life. It therefore is crucial to assure that the operators conscious brain is involved in an active system supervising over the whole work time period. It is possible to measure indirectly the level of the operators conscious brain involvement using eye motility analysis. Although there are capable sensors</p> <p>I. INTRODUCTIONThe recording physiological Blue the eyes system operators The provides basic most</p> <p>technical means for monitoring and parameters.</p> <p>important parameter is saccadic activity, which enables the system to monitor the status of the operators visual attention along with head acceleration, which accompanies large displacement of the visual axis (saccades larger than15 degrees). Complex industrial environment can create a danger of exposing the operator to toxic substances, which can affect his cardiac, circulatory and pulmonary systems. Thus, on the grounds of plethysmographic signal taken from the forehead skin surface, the system computes heart beat rate and blood oxygenation. The The Blue eyes system checks above parameters against abnormal (e.g. a low level of blood oxygenation or a high pulse rate) or undesirable (e.g. a longer attention) period of lowered visual values and triggers user-</p> <p>available on the market, a complex solution enabling transformation, analysis and reasoning based on measured signals still does not exist. In large control rooms, wiring the operator to the central system is a serious limitation of his mobility and disables his operation. Utilization of wireless technology becomes essential.</p> <p>defined alarms when necessary. Quite often in an emergency</p> <p>situation operators speak to themselves expressing operators their surprise or stating verbally the problem. Therefore, the voice, physiological parameters and an overall view of the operating room are recorded. This helps to reconstruct the course of operators work and provides data for long-term analysis. BlueEyes consists of a mobile measuring device and a central analytical system. The mobile device is integrated with Bluetooth module providing wireless interface between sensors worn by the operator and the central unit. ID cards assigned to each of the operators and adequate user profiles on the central unit side provide necessary data</p> <p>Bluetooth connection, buffers incoming sensor further data, performs on-line and data analysis, records the conclusions for exploration provides visualization interface.</p> <p>Figure1. Overall system diagram</p> <p>The task of the mobile Data Acquisition Unit are to maintain Bluetooth connection, to get information from the sensor and sending it over the wireless connection ,to deliver the alarm messages sent from the Central System Unit to the operator and handle personalized ID cards. Central System Unit maintains the other side of the Bluetooth connection, buffers incoming sensor data, performs on-line data analysis, records the conclusion for further exploration interface. and provides visualization</p> <p>personalization so different people can use a single mobile device (called hereafter DAU Data Acquisition Unit). The overall system diagram is shown in Figure 1. The tasks of the mobile Data Acquisition Unit are to maintain Bluetooth connections, to get information from the sensor and sending it over the wireless connection, to deliver the alarm messages sent from the Central System Unit to the operator and handle personalized ID cards. Central System Unit maintains the other side of the</p> <p>II. PERFORMANCE REQUIREMENTSThe portable nature of the mobile unit results in a number of performance requirements. As the device is intended to run on batteries, low power consumption is the most important constraint. Moreover, it is necessary to assure proper timing while receiving and transmitting sensor signals. To make the operation comfortable the device should be lightweight and electrically safe. Finally the use of standard and inexpensive ICs will keep the price of the device at relatively low level. The priority of the central unit is to provide real-time buffering and incoming sensor signals and semi-real-time processing of the data, which requires speed-optimizes filtering and reasoning algorithms. Moreover, the design should assure the possibility of distributing the processing among two or more central unit nodes (e.g. to offload the database system related tasks to a dedicated server).</p> <p>Blue eyes system monitors the status of the operators visual attention through measurement of rate and blood saccadic activity. The against system checks parameters like heart beat oxygenation abnormal and triggers user defined alarms. BlueEyes analytical system consists of a mobile measuring device and a central system. The mobile device is integrated with Bluetooth module providing wireless interface between sensors worn by the operator and the central unit. ID cards assigned to each of the operators and adequate user profiles on the central unit side provide necessary data personalization so The system consists of &gt; Mobile measuring device (DAU) &gt;Central System Unit (CSU)</p> <p>Figure2. System overview</p> <p>III. SYSTEM OVERVIEWS</p> <p>IV. THE HARDWARE4.1. DATA ACQUISITION UNIT:Data Acquisition Unit is a mobile part of the Blue eyes system. Its main task is to fetch the physiological data from the sensor and to send it to the central system to be processed. To accomplish the task the device must manage wireless Bluetooth connections (connection ID cards and PIN establishment, codes provide authentication and termination). Personal operator's authorization.Communication is carried on using a</p> <p> Jazz Multisensor interface Beeper and LED indicators ,6 AA batteries and voltage level monitor</p> <p>Figure3. DAU components</p> <p>with the operator</p> <p>simple 5-key keyboard, a small LCD display and a beeper. When an exceptional situation is detected the device uses them to notify the operator. transferred using a Voice data is small headset, the</p> <p>4.2. CENTRAL SYSTEM UNIT:Central System Unit hardware is second peer of the wireless connection. The box contains a Bluetooth module (based on ROK101008) and a PCM codec for voice data transmission.The module is interfaced to a PC using a parallel, serial and USB cable. The audio</p> <p>interfaced to the DAU with standard minijack plugs. The Data Acquisition Unit comprises several hardware modules: Atmel 89C52 microcontroller -</p> <p>data is accessible through standard mini-jack sockets To program operator's personal ID cards we developed a simple</p> <p>system core Bluetooth module (based on</p> <p>ROK101008) HD44780 - small LCD display 24C16 - I2C EEPROM (on a removable ID card) MC145483 13bit PCM codec</p> <p>programming device. The programmer is interfaced to a PC using serial and PS/2 (power source) ports. handles UART Inside, there is which I2C and Atmel 89C2051 microcontroller, transmission EEPROM (ID card) programming.</p> <p>consumer thread safe queues. Any number of consumers can register to receive the data supplied by a producer. Every single consumer can register at any number of producers, receiving therefore different types of data. Naturally, every consumer may be a producer for other consumers. Connection responsibleFigure4. CSU components</p> <p>Manager</p> <p>is</p> <p>for managing</p> <p>the wireless</p> <p>communicationbetween the mobile Data Acquisition Units and the central system. Data Analysismodule performs the analysis of the raw sensor data in order toobtain information about the operators Blue Eyes software's main task is to reaction look on after the working operators' operators' user condition physiological condition. To assure instant change the software performs real time buffering of the incoming data, real-time physiological triggering. comprises between transfers data analysis and alarm The Blue Eyes software several other raw functional modules physiological condition. Visualization module interface for provides a It the supervisors.</p> <p>V. THE SOFTWARE</p> <p>enables them to watch each of the working operators physiological condition along with a preview of selected video source and related sound stream. All the incoming alarm messages are instantly signaled to the supervisor. The Visualization module can be set in an offline mode, where all the data is fetched from the database. Watching all the recorded physiological parameters, alarms, video and audio data the supervisor is able toreconstruct the course of the selected operators duty.</p> <p>System core facilitates the transfers flow system modules (e.g. data to from data data the analyzers, analyzers,</p> <p>ConnectionManager GUI data controls, are</p> <p>processed data from the data analyzers to other logger etc.). The System Core single-producer-multi-</p> <p>fundamental</p> <p>state.</p> <p>An</p> <p>important</p> <p>element</p> <p>of</p> <p>incorporating emotion into computing is for productivity for a computer user. A study (Dryer &amp; Horowitz, 1997) has shown that people with personalities that are similar or complement people view their personality. For each other collaborate well. Dryer (1999) has also shown that computer as having a these reasons, it is</p> <p>important to develop computers which can work well with its user.</p> <p>VII. TYPES OF MOTIONAL SENSORS:Figure5. Software analysis diagram</p> <p>VI. EMOTION COMPUTINGRosalind Picard (1997) describes why emotions are important to the computing community. There are two aspects of affective computing: giving the computer the ability to detect emotions and giving the computer the ability to express emotions. Not only are emotions crucial for rational decision making as Picard describes, but emotion detection is an important step to an adaptive computer system. An adaptive, smart computer system has been driving our efforts to detect a persons emotional</p> <p>For Hand: Emotion Mouse Sentic Mouse For Eyes: Expression Glasses Magic Pointing Eye Tracking For Voice: Artificial Inteligence Speech Recognition</p> <p>VIII. EMOTION MOUSEOne proposed, noninvasive</p> <p>method for gaining user information through touch is via a computer input device, the mouse. This then allows the user to relate</p> <p>the cardiac rhythm, the body temperature, electrical conductivity of the skin and other physiological attributes with the mood. This has led to the creation of the Emotion Mouse. The device can measure heart rate,temperature, galvanic skin response</p> <p>IX.</p> <p>SENTIC MOUSEIt is a modified computer mouse that</p> <p>includes a directional pressure sensor for aiding in recognition of emotional valence (liking/attraction vs. disliking/avoidance)</p> <p>and minute bodily movements and matches them with six emotional states: happiness, surprise, anger, fear, sadness and disgust. The mouse includes a set of sensors, including infrared detectors chips. and TheseFigure7. Senetic mouse</p> <p>temperature-sensitive</p> <p>components, User researchers stress, will also be crafted into other commonly used items such as the office chair, the steering wheel, the keyboard and the phone handle. Integrating the system into the steering wheel, for instance, could allow an alert to be sounded when a driver becomes drowsy.</p> <p>X. EXPRESSION GLASSESA wearable device which allows any viewer to visualize the confusion and interest levels of the wearer. Other recent developments in related technology is the attempt to learn the needs of the user just by following the interaction between the user and the computer in order to know what he/she is interested in at any given moment. For example, by remembering the type of websites that the user links to according to the mood and time of the day, the computer could search on related sites and suggest the results the user.</p> <p>Figure6. Emotion mouse</p> <p>target.Two specific techniques, liberal, were</p> <p>MAGIC</p> <p>pointing and one</p> <p>one conservative</p> <p>designed, analyzed, and</p> <p>implemented with an eye tracker we developed. They were then tested in a pilot study. This showed that early stage exploration pointing effort and the MAGIC</p> <p>techniques might offer many advantages,Figure8. Expression Glass</p> <p>including reduced physical</p> <p>fatigue as compared to traditional manual</p> <p>XI.</p> <p>MAGIC POINTING</p> <p>pointing, greater accuracy and naturalness than traditional gaze faster speed pointing, and possibly than manual to the</p> <p>This work explores a new direction in utilizing eye gaze for computer Gaze tracking has long been pointing method for We believe limitations pointing. with a that exist with In particular, it motor control an input. considered input.</p> <p>pointing. In our view, there are two fundamental existing technology. shortcomings gaze pointing techniques,</p> <p>as an alternative or potentially superior computer many fundamental traditional gaze is unnatural to task. We</p> <p>regardless of the maturity of eye tracking</p> <p>XII. EYE TRACKINGSince the goal of this work is to explore MAGIC pointing as a user interface technique, we started out by purchasing a commercial eye tracker (ASL Model 5000) after a market survey. In comparison to the system reported in early studies this system is much more compact variety of and reliable. with as However, we felt that it was still not robust enough for a different eye people such characteristics,</p> <p>overload a perceptual channel such as vision therefore propose approach, alternative</p> <p>dubbed MAGIC (Manual And</p> <p>Gaze Input Cascaded) pointing. With such an approach, pointing appears to the user to be a manual large portion of task, used for fine a manipulation and selection. However,</p> <p>the cursor movement is</p> <p>eliminated by warping the cursor to the eye gaze area, which encompasses the</p> <p>pupil brightness and correction glasses. We hence chose to develop and use our own eye made by tracking ISCAN and that system. such Applied rely on a Available as those Science single commercial echnologies, light source systems,</p> <p>representing those processes via machines (like com...</p>