31
WINLAB Whose Move is it Anyway? Authenticating Smart Wearable Devices Using Unique Head Movement Patterns Sugang Li, Ashwin Ashok, Yanyong Zhang, Chenren Xu, Janne Lindqvist, Macro Gruteser PerCom 2016

Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Whose Move is it Anyway?

Authenticating Smart Wearable Devices Using Unique Head Movement Patterns

Sugang Li, Ashwin Ashok, Yanyong Zhang, Chenren Xu, Janne Lindqvist, Macro Gruteser

PerCom 2016

Page 2: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Project Highlights

• We design HeadBanger

• We achieve accurate user authentication

• Experiment with 95 subjects

• High TPR and Low FAR

• Robust against Attack

• We build an running app on Google Glass

2

Page 3: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Personal Information Is in Your Wearables !

3Vital Sign

Picture & VideoLocation

Gaming Asset

Page 4: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Cumbersome

Existing Approaches: Indirect Authentication

Lack of independency

4

Page 5: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Not Intuitive Pattern

Long Input Period

Limited Input Area

Existing Approaches: Built-in Authentication

5

Page 6: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Physical Biometrics:

Additional Hardware

Not always applicable for head-mounted device

Existing Approaches: Biometrics

6

Page 7: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Existing Approaches: Biometrics

Behavioral Biometrics:

Walking gait, arm swing, finger gesture, etc.

But, for head movements:

Hard to collect long-term movement patterns

Do not have high Degree of Freedom

7

Page 8: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Challenges

8

Low Degree of Freedom

Lack of long-term Habit

Limited InputArea

Invisible Input Pattern

ConstrainedRecourses

Page 9: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Music-induced Head Movement

9

Page 10: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Music-induced Head Movement

10

• 30 Subjects• Same movement and same music 30 times

Page 11: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Response Time Is Not Enough

Average Distances between the false users and the true user

Average distance between the true user and itself

11

Page 12: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Headbanger Rationales

12

Dist. Of the Same User

<< Dist. Of Two Users

Page 13: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Headbanger Overview

Filtering

DistanceComputing

Thresholding

Authentication

Ave. DistanceComputing

RankingTemplate

Reference Data

Training Phase

13

Data Collection

Page 14: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Data Filtering

14

• Accelerometer Contains High Frequency Noise

• Head Movement is at Low Frequency ( < 5 Hz)

Page 15: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Headbanger Overview

Filtering

DistanceComputing

Thresholding

Authentication

Ave. DistanceComputing

RankingTemplate

Reference Data

Training Phase

15

Data Collection

Page 16: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

D(A , B) =

k

s

s

k

s

ss

w

wpd

1

1

)(

d(ps): distance between is and js

P

minarg

ws > 0: weighting coefficient.

Best alignment path between

A and B :

Time-normalized distance

between A and B :

P1 = (D(A , B)).

js

is

m

1

n1

Time Series A

pk

ps

p1

Time Series B

Dynamic Time Warping

16

Page 17: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Headbanger Overview

Filtering

DistanceComputing

Thresholding

Authentication

Ave. DistanceComputing

RankingTemplate

Reference Data

Training Phase

17

Data Collection

Page 18: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Reduce the Computing Overhead

Choose Representative Samples

• Compute the average distance to other samples

• Rank the samples based on their average distance

• Threshold can be expressed as:

𝑇ℎ𝑟𝑒𝑠ℎ𝑜𝑙𝑑 = 𝑑𝑘 + n × 𝜎𝑘

18

Page 19: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Repeatability & SimilarityExperiment

Setup: 30 subjects are involved

Each of them design its own pattern

Each of them performs it 40 times

19

Objectives: True user can login with

high probability

Different user do different movement

Low computing cost

Page 20: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Evaluation Metrics

True Positive Rate

False Accepted Rate

Equal Error RateEER = TRR(n) = FAR(n)

20

Page 21: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Impact of Distance Algorithm

21

Page 22: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Impact of Voting Scheme

22

Page 23: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Impact of Training Size

23

Page 24: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Impact of Music Duration

24

Page 25: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Overall

25

Page 26: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Let’s Attack it!

26

Page 27: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Let’s Attack It!

27

One More Try!

1. Watch the user’s movement video

2. Mimic the user’s movement

3. Headbanger displays the authentication result

Page 28: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Attack Results

Target # of Attackers

# of SuccessfulAttackers

Average # of Trials

before 1st

Successful Attack

FAR (%)

A 12 7 10 15.83

B 13 3 14 2.77

C 12 3 17 2.72

Overall 38 13 13 6.94

28

Page 29: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Prototyping

Google Glass Development Kit

Java Speech Tool Kit

Fast DTW: 𝑂 𝑛2 → 𝑂(𝑛)

Task pipelining

Music Cue Duration (s)

Data processing latency (s)

10 1.93

6 1.15

5 0.88

29

Page 30: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Conclusion

We design Headbanger

We Conduct Intensive Experiment

Repeatability, Robustness

We develop a running App on Google Glass

30

Page 31: Whose Move is it Anyway? Authenticating Smart Wearable ...winlab.rutgers.edu/~sugangli/papers/headbanger.pdf · Whose Move is it Anyway? Authenticating Smart Wearable Devices Using

WINLAB

Thank you! Questions?

31