A Biometrics-embedded System Based on Haptics for User Authentication in Virtual Environments

MCRLabhttp://www.mcrlab.uottawa.ca

A Biometrics-embedded System Based on Haptics for User Authentication in Virtual Environments

Presented by Mauricio Orozco

UniversityOf OttawaSITE/EITI

October 2007


Outline

• Introduction• Contributions• Research Statement• Outline Architecture• Methodology• Conclusions• Future Work


Contributions

−Results suggest that haptic-based biometrics are best suited to verification

•The amount of information contained in an individual’s features characterizes(i.e. Force and Torque )the uniqueness of an individual

–Analysis and definition of features and feature set

•The user behavior exhibited in Virtual Domains should be modeled as “entropic signatures” according to features that are consistently unique for each user

•At 25% False Acceptance Rate (FAR), the Probability of Verification (PV) for haptic-based Application (i.e. “maze”) identification was at best 75.5%,While the PV of verification system was at best 98%

•Combining haptic technology to discriminate human-hand psychomotor patterns to be used for authentication/verification purposes

–Design and development of a procedure for:

•Haptic data to be used as biometric identifiers to characterize the human Interaction behaviour


Papers in refereed Journals

1. Mohamad Eid, Mauricio Orozco and Abdulmotaleb El Saddik, "A Guided Tour in Haptic Audio Visual Environment and Applications", Int. J. of Advanced Media and Communication. Vol.1 (3), 2007

2. Abdulmotaleb El Saddik, Mauricio Orozco, Yednek Asfaw, Shervin Shirmohammadi and Andy Adler, "A Novel Biometric System for Identification and Verification of Haptic Users", IEEE Transactions on Instrumentation and Measurement, vol.56 (3) 2007.

3. Mauricio Orozco, Matthew Graydon, Shervin Shirmohammadi, and Abdulmotaleb El Saddik, "Experiments in Haptic-Based Authentication of Humans", Journal of Multimedia Tools and Applications, 2007

4. Mauricio Orozco and Abdulmotaleb El Saddik “AdHapticA” IEEE Transactions on Instrumentation and Measurement, accepted to appear in 2008

Papers in refereed Conferences

1. Mauricio Orozco, Matthew Graydon, Shervin Shirmohammadi and Abdulmotaleb El Saddik, "Using Haptic Interfaces for User Verification in Virtual Environments", In proceedings of the 2006 IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems, Spain, July 2006.

2. Ismail Shakra, Mauricio Orozco, Abdulmotaleb El Saddik, Shervin Shirmohammadi, Edward Lemaire, "VR-Based Hand Rehabilitation using a Haptic-Based Framework", In proceedings of the 2006 IEEE Instrumentation and Measurement Technology Conference (IMTC/06), Sorrento, Italy, 24 - 27 April 2006.

3. Ismail Shakra, Mauricio Orozco, Abdulmotaleb El Saddik, Shervin Shirmohammadi, Edward Lemaire, "Haptic Instrumentation for Physical Rehabilitation of Stroke Patients", In proceedings of the 2006 IEEE International Workshop on Medical Measurement and Applications Benevento, Italy 20 - 21 April 2006.

4. Mauricio Orozco, Yednek Asfaw, Shervin Shirmohammadi, Andy Adler, and Abdulmotaleb El Saddik, "Haptic-Based Biometrics: A Feasibility Study", In Proceedings of the IEEE VR 2006, pp. 265 - 271, March 25-29, Alexandria, Virginia, USA, 2006.

5. Yednek Asfaw, Mauricio Orozco, Shervin Shirmohammadi, Abdulmotaleb El Saddik, Andy Adler, "Participant Identification in Haptic systems using HMMs", In Proceedings of the fourth IEEE International Workshop on Haptic Virtual Environments and their Applications (HAVE2005)", pp. 127 -132 2005.

6. Mauricio Orozco and Abdulmotaleb El Saddik, "Haptic: The New Biometrics-embedded Media to Recognizing and Quantifying Human Patterns" In proceedings of 13th Annual ACM International Conference on Multimedia (ACM-MM 2005), Singapore, November 06-12, 2005.

7. Mauricio Orozco , Ismail Shakra and Abdulmotaleb El Saddik, “Adaptive Haptic Framework”, In proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems, Giardini Naxos, Italy, 18-20 July 2005.

8. Mauricio Orozco and Abdulmotaleb El Saddik, “Signature Identification with Haptic devices”, In proceedings of the IEEE International Conference on Virtual Environments, Human-Computer Interfaces, and Measurement Systems, Giardini Naxos, Italy, 18-20 July 2005.

9. Mauricio Orozco, Yednek Asfaw, Andy Adler, Shervin Shirmohammadi, and Abdulmotaleb El Saddik, “Automatic Identification of Participants in Haptic Systems”, In proceedings of the 2005 IEEE Instrumentation and Measurement Technology Conference (IMTC/05), Ottawa, Ontario, Canada, 17-19 May 2005.

Publications from this thesis


Motivation

Haptic Technology & Apps

Haptics

Source: International Biometric Group, New York, NY

BiometricsBiometric Technology & Apps

Leve

l of I

nter

actio

n

Time

Internet

Telepresence +Haptics

TelephonyLetters


Why Use Haptics?

Haptics

Digital Tablet

CyberGlove

Mouse

Keyboard

Velocity

Torque

Angular

orientation

Pressure

Force

3D P

osition

2D P

osition

Time


Introduction

Haptic Systems

Biometrics Systems


Research Statement

H1: The quantitative performance of specific haptic interface lies significantly in acceptable range to be considered as biometric identifier system

H0: The quantitative performance of specific haptic interface does not lie significantly in acceptable range to be considered as biometric identifier system

?


Related Work: Behavioral Biometrics

Behavioural Biometrics

Dynamic Signature Verification

[Fernandez et al, 2005],[Plamondon, 1990], …plenty

Keystroke Dynamics

[ Joyce and Gupta , 1990][ Umpresh and Williams, 1985][Obaidat and Sadoun,1997] and more

Mouse :DSV

[Everitt and McOwan, 2003]CyberGlove:DataGlove

[Everitt and McOwan, 2003]


Proposed Approach: AdHapticA

Adaptive Haptic FrameworkHaptic -Based Applications

+ Virtual Maze+ Virtual Cheque+ Virtual Phone

Feature Generation/Selection

Feature Generation :x = { Vx, Vy, Vz,...}

Preprocessing

Feature Selection:+ Relative Entropy

Classifier Design / Evaluation

+ K-means+ Neural Networks+ PCA + DTW+Nearest Neighbor

System EvaluationMatching Score

Data Acquisition Repository

Behavioural DAO

Methodology





Preprocessing






Behavioural DAO

Methodology




Haptic-Based Applications

CyberGrasp UnitMultiple Point Interaction

PHANToM Haptic Desktop

Single Point Interaction Applications







Preprocessing






Behavioural DAO

Methodology


Data Acquisition

Database consists ~ 109 volunteers( > 2 year )

Each providing 10 genuine samples:+ Handwritten signature+ Maze solved+ Dialled telephone codes

Participants were given the opportunityto practice each application before

Each process recorded among others parameters the pen’s position(x,y,z), force applied (N) and device angle (φ)


Analysis

Single Point Interaction

HAPTIC DEVICE

Multiple Point Interaction

DTW( Dynamic Time Warping

Spectral Analysis (FFT)

Functional Approach

Parametric ApproachK-Means

Majority Class.

Information Content

Euclidean Distance

Neural Networks


Functional Approach

Maze

Performance

Equal Error Rate (EER)22.3% with a threshold Matching Score of 0.195

Dynamic Time Warping

Spectral Analysis:FFT

Validation Scheme


Parametric Approach

Performance of Classifier

00.1

0.20.3

0.40.5

0.60.7

0.80.9

1

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1

FAR error rate

Virtual Check Maze Virtual Phone

Performance

Equal Error Rate (EER) of 6.0% with a threshold of 1.6 for the best (Cheque )Virtual Mobile

Phone

Maze

Virtual Cheque Feature Set: 35

Variables

Validation Scheme

Majority Rule


Analysis of the Haptic Information Content

• Advantages of Using Relative Entropy– Quantifies the information contained in a piece of data: in bits (if

using base-2 logarithms) – Another distinct advantage of using relative entropy as a measure of

biometric feature uniqueness is that it accounts for both the mean and variance of a distribution

– The Relative or Shannon entropy is a measure of the average information content the recipient

Tzyxzyxzyx FFFvvvX ],,,,,,,,,[

)()(log)()||(xqxpxpqpD

Xx

To measure the uncertainty associated with a random variable


Analysis :Information Content

Entropic signature characterizes the identity of an individual by how unique their features are

))||(),...2||2(),1||1(( qnpnDqpDqpDs

From a geometrical perspective, an entropic signature can be modeled as a curve in the plane

User 1

0

10

20

30

40

50

60

70

1 2 3 4 5 6

Biometric Feature

Rel

ativ

e En

trop

y [b

its]

User 2 User 3 User 4



Relative Entropy of User Features

0

10

20

30

40

50

60

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22

User

Rela

tive

Entro

py [b

its]

xy Torquexyz Torque

Force

Weighted Velocity

Stylus Velocity

Angular Orientation

The information content of biometric features differ amongst users of the haptic

0

10

20

30

40

50

60

70

80

1 2 3

xy Torque3D TorqueForcePositionStylus VelocityAngular Orientation


Authetication with Analysis of Information Content

Performance

Identification

EER=27%

Verification EER=4.5%

Equal Error Rate


Conclusions

TFvyxX ],,,,[

TFvzyxX ],,,,,,[

Relative Entropy

User Entropic Signature

],..,[],..,[ iFnFxTabletsXFnFxHapticsX T

Analysis of System Security

accept 19.14% +/- 3.5%

],,,,[ 22yyxyx ffX

Entropic Signature

accept 95.5% +/- 2.5% TPyxX ],,[

Majority Rule


Future Work

• Incorporating adaptive feedback between the feature extraction and the feature selection

• Reducing the size of haptic data• Combining with other Biometrics• Embedded in Game-like environment


متشکرم

谢谢

ありがとう

Thank you


Feedback

• On 1/9/07, Eamonn Keogh <[email protected]> wrote: Hello, I have read your nice paper [a]. You can make DTW significantly more accurate for this problem just by constraining the warping, see [b] or [c] :Professor from University of California USA.

• IEEE-VR Symposium in Virginia USA, March 2006The main contribution of the paper is that user identification can be possible in haptic manipulation task using several statistical analyses. However the result is affected by training existence or nonexistence, so this can be a disadvantage for haptic systems without trained users, or those where the user doesn’t frequently interact with the application

• IEEE-HAVE Ottawa, Ontario, October 2005 ReviewerIf the authors could show that the error rates are larger without the presence of haptics, then it might prove that the haptics are actually allowing greater behavioral variation, rather than less. For example, what if the subjects were asked to navigate the same maze with the haptic feedback turned off?

Documents

A Biometrics-embedded System Based on Haptics for User Authentication in Virtual Environments