14
SCALING GIS IN 3 ACTS presented by: Nick Dimiduk May 22, 2012 1

HBaseCon 2012 | Scaling GIS In Three Acts

Embed Size (px)

DESCRIPTION

Scaling geospatial data is hard. State of the art GIS technologies available to the general public are locked in the realm of relational databases with PostGIS as the prominent leader. Though a number of location-based startups have walked this path before, few have marked their trail along the way. Act one proveds a survey of the landscape, defining terms, and highlighting pitfalls. Act two explores the world of open source, horizontally scalable GIS and outlines the problems they solve. Act three explores implementations backed by HBase. No previous GIS knowledge is required.

Citation preview

Page 1: HBaseCon 2012 | Scaling GIS In Three Acts

SCALING GIS IN 3 ACTS

presented by:

Nick Dimiduk

May 22, 2012

1

Page 2: HBaseCon 2012 | Scaling GIS In Three Acts

SCALING GIS IN 3 ACTS- Lightning Edition! -

presented by:

Nick Dimiduk

May 22, 2012

2

Page 3: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

HBase in ActionManning Press, Fall 2012

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

3

hbaseinaction.com

Discount code: 12hb10

Page 4: HBaseCon 2012 | Scaling GIS In Three Acts

Act I: What is GIS?

Page 5: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

GIS: Data (on maps!)

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

5

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

Page 6: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

HC SVNT DRAGONES

“Here are Dragons”

0

1

2

3

4

5

6

7

8

9

10Thousands

MULTI-BAR CHART TITLE, LEFT ALIGNED

Series 1 Series 2 Series 3 Series 4

6

DRAGONES!!!

Image: Psalter World Map, 1265

http://en.wikipedia.org/wiki/Here_be_dragons

Page 7: HBaseCon 2012 | Scaling GIS In Three Acts

Act II: What to do with GIS?

Page 8: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

Geospatial Queries

8

Page 9: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

Non-Euclidean Geometry

9

Image: Trigonometry on a Spehere

http://en.wikipedia.org/wiki/Non-Euclidean_geometry

“Know thy surface”

Page 10: HBaseCon 2012 | Scaling GIS In Three Acts

Act III: GIS on HBase

Page 11: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

The devil is in the Indices

12

Image: Six iterations of the Hilbert curve

http://en.wikipedia.org/wiki/Space-filling_curve

Page 12: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

Spatial Partitioning

14

Image: USA night lights

http://www.noaanews.noaa.gov/stories/s2015.htm

Page 13: HBaseCon 2012 | Scaling GIS In Three Acts

© 2012 The Climate Corporation. All Rights Reserved. Policies are underwritten by State National Insurance Company, Inc. and administered by The Climate Insurance Agency LLC.

The devil is in the (Spatial) Indices

16

Image: German zipcodes, R*Tree

http://en.wikipedia.org/wiki/R*_tree

Page 14: HBaseCon 2012 | Scaling GIS In Three Acts

Thank you!