28
Siyuan Liu *# , Yunhuai Liu * , Lionel M. Ni *# + , Jianping Fan # , Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences + Shanghai Jiao Tong University July 27 th , 2010@SIGKDD 2010 Towards Mobility-based Clustering

Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Embed Size (px)

Citation preview

Page 1: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Siyuan Liu*#, Yunhuai Liu*, Lionel M. Ni*# +, Jianping Fan#, Minglu Li+

*Hong Kong University of Science and Technology#Shenzhen Institutes of Advanced Technology, Chinese Academy of

Sciences+ Shanghai Jiao Tong University

July 27th, 2010@SIGKDD 2010

Towards Mobility-based Clustering

Page 2: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

OutlineIntroductionRelated workMobility based clusteringField study evaluationConclusion

Page 3: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

OutlineIntroductionRelated workMobility based clusteringField study evaluationConclusion

Page 4: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Smart City [1]

China's urbanizationMassive issues and problems

City monitoring and managementPervasive information and knowledge

Digital technologyData collection, storage and miningReal life data sets

Vehicle GPS data sets (one year, two cities)Mobile phone networks data sets (one year, two

cities)

Hot spot detection in the city

[1] Smart City Research Group. http://www.cse.ust.hk/scrg

Page 5: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Motivation

Vehicle instant locations of sample taxis at 13:00PM on 12th Dec, 2006

Traffic congesti

on

Event detectio

n

Commercial

promotion

Crowded spots and areas in the

city

Page 6: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Data setIdeal case: we should have all information

of all vehicles in the cityReality: only a sample set of all vehicles

Taxi GPS data (ID, location, speed, time, direction, status)

0.3% of the two million vehicles in Shanghai

Could we utilize such a very limited sample set to detect

hot spot in the city?

Page 7: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Challenges

Extremely limited sample

set

Dense?

Sparse?

Sparse!

Dense!Notable location

error

Could density based clustering handle it?

Page 8: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

MethodologyObservation

The low speed may indicate that the area is crowded

MethodMobility-based clusteringStudy the speed (mobility) instead of the

density

Moving objects as sensors

Page 9: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

OutlineIntroductionRelated workMobility based clusteringField study evaluationConclusion

Page 10: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Related Work

•Partitioning methods•Hierarchical methods•Density based methods•Grid based methods•Model based methodsetc.

•Raw data based methods•Feature based methods•Model based methodsetc.

What if the mobility is high?What if the density is poor?What if the location is lossy?

10

Density based clustering

Page 11: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

OutlineIntroductionRelated workMobility based clusteringField study evaluationConclusion

Page 12: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Mobility-based Clustering

12Roadmap

Page 13: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Object Mobility ModelSpeed estimation

Road network gridInterpolation

Direction distinguishing

Speed spectrum of road direction

Speed spectrum of reverse direction

NanPu Bridge13

Page 14: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Spot Crowdedness ModelLinear crowdedness function

Statistical crowdedness function

( )( )( ) max

max min

( ) ( )( ) ( ) (1 )

( ) ( )l

ttt

l lL Lv l v l

l lv l v l

( )( ) ( )( ) ( ) (1 ) (1 ( ( )))ltt tl lS Sl l v v l

14

Page 15: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Crowdedness Model ValidationValidation

1. Taxis traces 2. Buses tracesO r i g i n a l d a t a s e t Input

set Ф

Test set Фc

Randomly split to two parts

Crowdedness computation

Mobility estimation

ValidationMobility

error

15

Page 16: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in Practice

Characterizing spots

α, г

Sensor object profiling

Hot spots and hot regions

Temporal hot spots

Evolutionary hot regions

Spot crowdednes

s

16

Learning in Mobility Based Clustering

Page 17: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in PracticeCharacterizing spots

17

Page 18: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in PracticeSensor object profiling

18

Page 19: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in PracticeSensor object profiling

19

Page 20: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in PracticeHot spots and hot regions

( ) ( ) ( ) { | 0, ' , ( ', ) ( ') ( )}t t ts sHot spot Ls l l A dist l l l l

( ) ( ) ( ) { | , ( ) }t tth s thHot region Rs l l A l

20

Hot spot, even sparse sample points

NOT hot spot, even dense sample points

Page 21: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in PracticeTemporal hot spots

Event detection Temporal consistence

Page 22: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Learning in PracticeEvolutionary hot regions

Area difference ratioCrowdedness difference ratio

22

Page 23: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

OutlineIntroductionRelated workMobility based clusteringField study evaluationConclusion

Page 24: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Field Study Evaluation

24

Page 25: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Field Study Evaluation

25

Page 26: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

OutlineIntroductionRelated workMobility based clusteringField study evaluationConclusion

Page 27: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Conclusion and Future WorkContributions

Mobility-based clustering modelKey factors on spot crowdednessHot spots and hot regions

Future workMore accurate speed informationMore accurate location information

Page 28: Siyuan Liu *#, Yunhuai Liu *, Lionel M. Ni *# +, Jianping Fan #, Minglu Li + * Hong Kong University of Science and Technology # Shenzhen Institutes of

Thanks for your attention!