http://www.52north.org/wpsFOSS4G 2009

Geoprocessing in the Clouds

FOSS4G 2009

Bastian Schäffer52°North

http://www.52north.org/wpsFOSS4G 2009

Agenda

Cloud Computing SDI to Cloud Transition The 52North WPS in the Clouds

http://www.52north.org/wpsFOSS4G 2009

Cloud Computing

http://www.52north.org/wpsFOSS4G 2009

http://www.52north.org/wpsFOSS4G 2009

Cloud Hype

http://www.52north.org/wpsFOSS4G 2009

Characteristics

• Efficiency Resource Pooling

• Outtasking

• On-demand

no-long term contracts

• Scalability

• Cost

http://www.52north.org/wpsFOSS4G 2009

IaaS

PaaS

dSaaSSaaS

http://www.52north.org/wpsFOSS4G 2009

Technology

• Hardware Cluster

• Virtualization

• Grid Computing

• Application Framework

• etc.

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

http://www.52north.org/wpsFOSS4G 2009

Cloud Types

http://www.52north.org/wpsFOSS4G 2009

Provider

• Amazon Web Services– Virtual (Machine) Computing Environment– Simple Storage Service (Amazon S3), SimpleDB,

Elastic Compute Cloud (Amazon EC2), Elastic MapReduce, etc.

– „0,10$ / hour“ for an running virtual system• Google App Engine

– Web applications written in Java and Python– Storage Service, Google Applications (Mail, Account)– „0,10$ / hour“ for real CPU usage

• Microsoft, Apple, SUN, IBM, Salesforce, etc.

http://www.52north.org/wpsFOSS4G 2009

Projects

• DMTF Open Cloud Standards Incubator

• The Open Cloud Consortium (OCC)

• Open Cirrus - Open Cloud Computing Research Testbed

• Open Cloud Manifesto

http://www.52north.org/wpsFOSS4G 2009

SDI to Cloud Transition

http://www.52north.org/wpsFOSS4G 2009

SDI to Cloud Transition

• CloudSDI vs. SDICloud

http://www.52north.org/wpsFOSS4G 2009

SDI concepts

• Technical / Service Perspective

SDI provides georesources through standardized interfaces over a service infrastructure

http://www.52north.org/wpsFOSS4G 2009

Processing (WPS)

Data Provision(WFS, WCS, SOS)

Portrayal (WMS)

Discovery (CSW)

http://www.52north.org/wpsFOSS4G 2009

IaaS

PaaS

dSaaSSaaS

Processing (WPS)

Data Provision(WFS, WCS, SOS)

Portrayal (WMS)

Discovery (CSW)

http://www.52north.org/wpsFOSS4G 2009

IaaS

PaaS

dSaaSSaaS

Processing (WPS)

Data Provision(WFS, WCS, SOS)

Portrayal (WMS)

Discovery (CSW)

http://www.52north.org/wpsFOSS4G 2009

Major Obstacles

• IT investments & maintenance

• Mass market

• Legally Binding Performance

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

• High investments

<hardware, software, humans>

(for seldomly used tasks)outtasking & on demand use

e.g. Taiwan Debris Flow, French SDI Portal

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

time

requ

ests

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

time

requ

ests

20.000$

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

time

requ

ests

20.000$

40.000$

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

time

requ

ests

20.000$

40.000$

80.000$

Taifun?

http://www.52north.org/wpsFOSS4G 2009

IT investments & maintenance

time

requ

ests

20.000$

40.000$

80.000$

120.000$

http://www.52north.org/wpsFOSS4G 2009

Mass market

• Mass Market Application many requestsScaleability

http://www.52north.org/wpsFOSS4G 2009

Mass market

http://www.52north.org/wpsFOSS4G 2009

Mass market

http://www.52north.org/wpsFOSS4G 2009

Mass market

http://www.52north.org/wpsFOSS4G 2009

Legally Binding Performance

• INSPIRE– Search Queries

• Maximum 3 sec response time*

• Handle 30 parallel requests per second

– Image Download• Maximum 5 sec response time*

• Handle 20 parallel requests per second

– Overall 99% service availability (362 days/year uptime)

* During normal traffic (90% of uptime).

http://www.52north.org/wpsFOSS4G 2009

SDI Role Model

http://www.52north.org/wpsFOSS4G 2009

publish

publish

find

bind

bind

Georesource owner/provider

Georesource owner/provider

Publish-Find-Bind

http://www.52north.org/wpsFOSS4G 2009

publishpublishfind

bind

bindGeoresource owner

Georesource owner

Georesource provider

Georesource provider

http://www.52north.org/wpsFOSS4G 2009

The 52°North WPS in the Clouds

http://www.52north.org/wpsFOSS4G 2009

WPS 101

What is a WPS?

Web Based Processing

WPS

WPS

http://www.52north.org/wpsFOSS4G 2009

SDI Integration

• Processing

http://www.52north.org/wpsFOSS4G 2009

SDI Integration

• Processing

http://www.52north.org/wpsFOSS4G 2009

SDI Integration

• Processing

http://www.52north.org/wpsFOSS4G 2009

SDI Integration

• Processing

http://www.52north.org/wpsFOSS4G 2009

SDI Integration

• Processing Service

http://www.52north.org/wpsFOSS4G 2009

Amazon EC2

http://www.52north.org/wpsFOSS4G 2009

Amazon EC2

MasterImage„ami“

CloudWatch

AutoScale

http://www.52north.org/wpsFOSS4G 2009

Amazon EC2

SaaS

PaaS

IaaS

http://www.52north.org/wpsFOSS4G 2009

Amazon EC2

http://www.52north.org/wpsFOSS4G 2009

Google Apps Engine

http://www.52north.org/wpsFOSS4G 2009

Google Apps Engine

101010010101

http://www.52north.org/wpsFOSS4G 2009

Google Apps Engine

http://www.52north.org/wpsFOSS4G 2009

Google Apps Engine

http://www.52north.org/wpsFOSS4G 2009

Conclusion

http://www.52north.org/wpsFOSS4G 2009

Conclusion

• SDI services can be deployed in cloud environments Change in role model (P-F-B)

http://www.52north.org/wpsFOSS4G 2009

publishpublishfind

bind

bindGeoresource owner

Georesource owner

Georesource provider

Georesource provider

http://www.52north.org/wpsFOSS4G 2009

Conclusion

• Google Cloud easy to use good for light-weight applicationGood integration with other google apps

• Amazon cloudMore complicated to useFull-scale solutionFlexible

Scaleability provided

http://www.52north.org/wpsFOSS4G 2009

Conclusion

• External Interoperability (Open Standards)

• NO internal interoperabilityVendor lock-in

Proposal:

http://www.52north.org/wpsFOSS4G 2009

Abstraction Layer

Abstraction Layer

SaaS

http://www.52north.org/wpsFOSS4G 2009

Abstraction Layer

Abstraction Layer

Geospatial Layerin the cloud

SaaSPaaS

http://www.52north.org/wpsFOSS4G 2009

Conclusion

Future:

Impact on GIS Business Models– Selling of full GIS packages SaaS

http://www.52north.org/wpsFOSS4G 2009

Thank You

schaeffer@52north.org