Tiles Under Heavy Artillery - Serving One Billion Maps Per Month

© Copyright 2016 Jawg 1

Tiles under heavy Artillery

Loïc Ortolahttp://jawg.io


Maps before

Maps have changed


Maps today


Is OpenStreetMap business-grade?


What does business-grade mean?

Efficient Scalable Available

Elastic Support


OpenStreetMap

•Community-driven

ODBL IS AWESOME

•Experienced• Independent


https://switch2osm.org/serving-tiles/manually-building-a-tile-server-14-04/

https://github.com/mapnik/mapnik/wiki

http://wiki.openstreetmap.org/wiki/Mod_tile

https://github.com/openstreetmap/mod_tile/blob/master/renderd.conf

https://github.com/openstreetmap/osm2pgsql/blob/master/README.md

http://wiki.openstreetmap.org/wiki/Osmosis/Replication

https://wiki.debian.org/OSM/tileserver/jessie

https://github.com/mapbox/carto/blob/master/README.md

https://mapzen.com/projects/vector-tiles/https://

github.com/openstre

etmap/chef

https://github.com/omniscale/imposm3

https://github.com/mapbox/mbtiles-spec

https://github.com/mapbox/vector-tile-spechttp://addok.readthedocs.io/en/0.5.x/

http://wiki.openstreetmap.org/wiki/FR:Nominatim

http://osmose.openstreetmap.fr/fr/OpenStreetMap… map servers?


Entry cost to OpenStreetMap


OpenStreetMap for business

1. Introduction2. The market of maps3. Map services

1. Definition2. Geocoding3. Routing4. Tiles5. GIS

4. Constraints / architecture5. Case study : mapping platforms

1. Primitives2. KPIs3. Bottlenecks4. Market Solutions

6. Analysis1. Scenario2. Documentation3. Support services4. Scalability5. Service-discovery compatibility6. Cloud integration

7. Assuming people are paying attention6. I am pretty sure No one will ever read this

line7. If you did though, I guess I owe you a beer8. A real beer. You know, since we’re in

Brussels…8. It’s been a long day don’t you think?

6. About that beer… My twitter is @loicortola9. Results10. I - need - pizza11. Raw data12. Conclusion


OpenStreetMap for business

1. Introduction2. The market of maps3. Map services

1. Definition2. Geocoding3. Routing4. Tiles5. GIS

4. Constraints / architecture5. Case study : mapping platforms

1. Primitives2. KPIs3. Bottlenecks4. Market Solutions

6. Analysis1. Scenario2. Documentation3. Support services4. Scalability5. Service-discovery compatibility6. Cloud integration

7. Assuming people are paying attention6. I am pretty sure No one will ever read this

line7. If you did though, I guess I owe you a beer8. A real beer. You know, since we’re in

Brussels…8. It’s been a long day don’t you think?

6. About that beer… My twitter is @loicortola9. Results10. I - need - pizza11. Raw data12. Conclusion


Can OSM services sustain a worldwide zombie infection?


The Zombie Pandemic

Virus = ZOMBIES Most services down


The Zombie Pandemic

• OSM app launched: WAZEWorld Against the Zombie Epidemic

• Localizes Safe Zones and resources


The Zombie Pandemic Scenario

200,000 potential users

@ 8pm local release

1.12 billion16% of

population uninfected

1.12 million0.1% of

remaining pop. w/ access


The Zombie Pandemic Scenario

Main.mp4


Load testing tool

• Cluster mode• Proper metrics• Live reporting


Architecture

Injectors

Caches

Load-balancer

Renderers CPU: 32RAM: 120GBBW: 2Gb/sSoftware: mod_tile, renderd, postgresql

CPU: 8RAM: 30 GBBW: 2 Gb/sSoftware: squid3

CPU: 8RAM: 30 GBBW: 2 Gb/sSoftware: HAProxy

CPU: 16RAM: 60 GBBW: 2 Gb/sSoftware: Gatling

Internet



YESObjective: 1 billion mapsReached: 56 billion maps

WAZE successfully saved the planet

Can OSM services sustain a worldwide zombie infection?


Load tests

New bottlenecks

In reality

Tuning storm

• > 50 Gbps BW• Saturation of

Cloud’s internal switch infrastructures

• Kernel• Configuration• Load-

balancing

+50 load tests to find the most adequate simulation


The Bottleneck Podium


The State Of The Map (Server)

Efficient Scalable Available

Elastic Support


White Papers

1. Map services: from theory to implementation• Available now @ jawg.io

2. Map services: Benchmarks & high-scale profiles• To be released in November 2016


Thank You

Loïc Ortola@LoicOrtola@jawgio

Technology

Tiles Under Heavy Artillery - Serving One Billion Maps Per Month