28
AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015 AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015 ©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved. Open GIS Data Jed Sundwall Open Data, AWS

Open GIS Data

Embed Size (px)

Citation preview

Page 1: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Open GIS Data

Jed Sundwall

Open Data, AWS

Page 2: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Agenda• Open data on AWS• Jaques Tardie, Snapsat• Ian Dees, OpenAddresses & OpenStreetmap• Chris Rasmussen, NGA

Page 3: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

What is open data?Open data is data that can be used by anyone for any purpose for free.

Many of our customers, such as Esri, the Weather Company, and the Climate Corporation, rely on quality open data as much as they rely on our computing, storage, and other web services.

Page 4: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Open data on AWSMaking data open on AWS enables more innovation by making data available for rapid access to our flexible and low-cost computing resources.

Page 5: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Landsat – big open dataThe Landsat program is a joint effort of

the U.S. Geological Survey and NASA.

It is the longest running program to

gather Earth imagery from space and

is considered the gold standard for

natural resources satellite imagery.

It can be time-consuming and

expensive to acquire, store, and

analyze Landsat data.

Page 6: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Landsat on AWSAWS has committed to make up to 1

petabyte of Landsat imagery available

through the AWS Public Data Set

program.

Over 170,000 Landsat 8 scenes are

available now, and about 700 are

added every day.

Now anyone can analyze Landsat data

at web scale with no up-front

investment of time or capital expense.

Page 7: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Landsat on AWSSince March 19 launch:

• 270 million hits from 147 countries

• >3 million hits per day on average

• 19TB of data transferred per day

• 2 brand new applications: Snapsat and

Astro Digital browser

• Fueling new product development from

Mapbox, Esri, CartoDB, MathWorks,

and Development Seed

Page 8: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Snapsat: Making Landsat imagery accessible

Jacques Tardie

Co-founder, Snapsat

Page 9: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

The cost of working with geospatial data has plummeted, thanks to:

• Technological innovation• Open source culture• Open data

Page 10: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Brilliant. this is the greatest leap in facilitating the use of satellite data I’ve ever seen. In 1990, it was a US$50K SGI workstation (three colours!), a separate US$20 K machine to run the tapes + US$20K of software. Oh, and each image cost US$625.

Page 11: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

It’s getting better, but…

Page 12: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

The learning curve remains steep

Page 13: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

The old process required:• Understanding the command line.• Knowing which tools to install• Knowing how to configure them• Time• Bandwidth

Page 14: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

The new process requires:• A browser• A mouse• A few clicks

Page 15: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

We flattened the curve

Page 16: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Why now, and why us?

Page 17: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

What does the future look like?

Page 18: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Special thanks to: • Amazon Web Services• Jed Sundwall• Code Fellows• Cris Ewing

Page 19: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Email [email protected]

Page 20: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Collecting the World’s Open Address Data

Ian Dees / @iandees

OpenAddresses & OpenStreetmap

Page 21: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Problems we’re trying to solve• Addresses are the human interface to

geographic data• A map isn’t usable by humans until they can

locate themselves• Street address is where everyone starts• Geocoders are the software that translates from

an address to a point on the map

Page 22: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Problems we’re trying to solve• Make it easier to build geocoders• Improve and promote access to open data• Share data improvements

Page 23: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Existing projects• OpenStreetMap

– 51M addresses, 30K monthly active users

• OpenAddresses.org• OpenAddressesUK

Page 24: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Our project• http://openaddresses.io• Crowd-sourced list of ~1000 open data

sources• Contributions are made through Github• Software stack to download and transform• 127M points, 64 contributors

Page 25: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Our project• Output is bare minimum right now:

lat, lon, house #, street, city, state, postcode

• We keep source data, so new outputs are trivial

Page 26: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Where to next?• Crowd-sourcing points isn’t sustainable,

we need more authoritative datasets• Convince entities to release data to the

public• Lots to do internationally, but still plenty to

do in the US

Page 27: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Where to next?• Feedback mechanism• Licensing• Organization

Page 28: Open GIS Data

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015

Thank You.This presentation will be loaded to SlideShare the week following the Symposium.

http://www.slideshare.net/AmazonWebServices

AWS Government, Education, and Nonprofit Symposium Washington, DC I June 25-26, 2015