24
Attraction and Avoidance Detection from Movements Zhenhui Jessie Li (with Bolin Ding, Fei Wu, Tobias Lei, Roland Kays, Meg Crofoot) Pennsylvania State University VLDB Conference Hangzhou, China September, 2014 1

Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Attraction and Avoidance Detection from Movements

Zhenhui Jessie Li (with Bolin Ding, Fei Wu, Tobias Lei, Roland Kays, Meg Crofoot)

Pennsylvania State University

VLDB Conference Hangzhou, China September, 2014

1

Page 2: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Mining Mobility Relationship Problem

•  Given two trajectories R and S, measure their relationship strength

2

R

Sr1

r2

r3

r4 r5 r6

s1

s2

s3s4

s5

s6

* assume synchronized sampling rate

Page 3: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Using Trajectory Similarity as a Measure of Mobility Strength

3

R

Sr1

r2

r3

r4 r5 r6

s1

s2

s3s4

s5

s6

d

freq(R,S) =nX

i=1

⌧(ri, si).

Meeting (or co-locating) frequency

⌧(ri, sj) =

⇢1, |ri � sj | d;0, otherwise.

Vlachos et al., Discovering similar multidimensional trajectories. ICDE’02 Chen et al., Robust and fast similarity search for moving object trajectories. SIGMOD’05 Jeung et al., Discovery of convoys in trajectory database. VLDB’08 Li et al., Mining relaxed temporal moving object clusters. VLDB’10

Page 4: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Meeting Frequency = Relationship Strength?

4

the more frequently you co-locate with another person,

the stronger the mobility relationship is.

less frequently

weaker

Page 5: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Meeting Frequency = Relationship Strength?

5

Example 1. A and B are friends living in different cities attracted to meet Freq(A, B) = 2

Example 2. A and C are colleagues working in the same building avoid meeting Freq(A, C) = 20

Meeting Frequency ≠ Relationship Strength

Page 6: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Consider Mobility Background to Infer Relationship

6

Example 1. A and B are friends living in different cities attracted to meet Freq(A, B) = 2

Example 2. A and C are colleagues working in the same building avoid meeting Freq(A, C) = 20

Mobility background

Expect(A, B) = 1 Expect(A, C) = 100

Page 7: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

What happened vs. What is expected to happen

7

Example 1. Freq(A, B) = 2 Expect(A, B) = 1

Example 2. Freq(A, C) = 20 Expect(A, C) = 100

What happened? What is expected?

Page 8: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

What happened vs. What is expected to happen

8

Example 1. Freq(A, B) = 2 Expect(A, B) = 1

Example 2. Freq(A, C) = 20 Expect(A, C) = 100

What happened? What is expected?

larger than smaller than

Attraction Avoidance How to estimate what is expected?

Page 9: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

How to Estimate Expectation?

•  Null hypothesis: Two movement sequences R and S are independent.

•  If we randomly shuffle the sequences,

•  the meeting frequency should remain the same

9

R ! �(R) S ! �(S)

freq(R,S) ⇡ freq(�(R),�(S))

Pr(freq(�(R),�(S) = y)) = Pr(freq(R,�(S) = y))

Shuffling two sequences = Shuffling one sequence

Page 10: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Permutation Test to Estimate the Probabilistic Background Model

10

r1 r2 r3 r4 r5

s1 s2 s3 s4 s5

R

S

If we randomly shuffle the sequence …

freq(R,S) = 2

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

r1 r2 r3 r4 r5

s5 s1 s3 s4 s2

R

σ(S)

freq(R,�(S)) = 0

Page 11: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Permutation Test to Estimate the Probabilistic Background Model

11

r1 r2 r3 r4 r5

s1 s2 s3 s4 s5

R

S

r1 r2 r3 r4 r5

s4 s2 s3 s1 s5

R

σ(S)

If we randomly shuffle the sequence …

freq(R,S) = 2

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

freq(R,�(S)) = 1

Page 12: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Permutation Test to Estimate the Probabilistic Background Model

12

…. n! permutations

….

freq(R, σ(S))

count

generate histogram

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

Page 13: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Compute Degree of the Relationship

13 freq(R, σ(S))

count

generate histogram

Actual frequency

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

Expected frequency

…. n! permutations

….

Page 14: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Compute Degree of the Relationship

14 freq(R, σ(S))

count

generate histogram

Actual frequency

95% area

Attraction relationship: 95% significance

Expected frequency

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

…. n! permutations

….

Page 15: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Compute Degree of the Relationship

15 freq(R, σ(S))

count

generate histogram

Actual frequency

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

Expected frequency

…. n! permutations

….

Page 16: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Compute Degree of the Relationship

16

generate histogram

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

freq(R, σ(S))

count Actual frequency

Expected frequency

98% area

Avoidance relationship: 98% significance

…. n! permutations

….

Page 17: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Compute Degree of the Relationship

17

…. n! permutations

….

freq(R, σ(S))

count

generate histogram

avoid attract

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

Expected frequency

Page 18: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Compute Degree of the Relationship

18

freq(R, σ(S))

avoid attract

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

Expected frequency

sigattract(R,S) = Pr[freq(R,S) > freq(R,�(S))]

sigavoid

(R,S) = Pr[freq(R,S) < freq(R,�(S))]

significant significant

Page 19: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Monte Carlo Scheme to Approximate Degree

•  The total number of permutations is factorial n! •  Monte Carlo scheme: sample N permutations

19

N � 4

✏2⇢ln

2

(1� ✏)⇢ ⇢̂ (1 + ✏)⇢

with probability 1� �

guarantee

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

Page 20: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Experiment on the Monkey dataset

20

12 monkeys 11/10/2004 – 04/18/2005

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

* green line: sig_{attract} > 0.95 * red line: sig_{avoid} > 0.95

Red: significant avoidance Green: significant attraction

Page 21: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Experiment on the Monkey dataset

21

12 monkeys 11/10/2004 – 04/18/2005

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

* green line: sig_{attract} > 0.95 * red line: sig_{avoid} > 0.95

Red: significant avoidance Green: significant attraction

Page 22: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Experiment on the Monkey dataset

22

12 monkeys 11/10/2004 – 04/18/2005

Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

* green line: sig_{attract} > 0.95 * red line: sig_{avoid} > 0.95

Red: significant avoidance Green: significant attraction

Page 23: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Comparison with Previous Measures

23 Z. Li et. al., Int. Conf. on Very Large Data Bases (VLDB'14/PVLDB)

attract

avoid

Page 24: Attraction and Avoidance Detection from Movementsfaculty.ist.psu.edu/jessieli/Publications/VLDB14-attract-avoid-slides.pdf · Attraction and Avoidance Detection from Movements Zhenhui

Zhenhui Jessie Li, Penn State University Mining Attraction and Avoidance from Movements

Summary and Future Work

•  Summary: Important to consider background – What happened vs. What is expected to happen – Consider mobility background using permutation test

•  Permutation test is one way, but not the only way to consider background context – How to deal with “impossible” trajectory? – How to deal with sparse observations?

•  Rich spatial and temporal context –  location semantics –  social events

24

Thanks! Questions?