Upload
others
View
3
Download
0
Embed Size (px)
Citation preview
Environmental Big Data
Evidence for Policy?
Landcare Research Link Seminar 15
Feb 26th, 2013
Robert Gibb Informatics Science Leader
… policy-makers underestimate
what the do not know”
while
“scientists overestimate the utility
of what they know …
Sir Peter Gluckman,
IPANZ, 2013-2-21
http://www.ipanz.org.nz/Folder?Action=View File&Folder_id=84&File=Gluckman:Communicating-and-using-evidence-in-policy-formation.pdf
NZ
$$
Policy &
Govt.
Global & Local
Environment
PART 3 .. Future perspective
PART 2 .. Fast forward to 2013
PART 1 .. Policy & Data 2010
aspiration meets cold reality
“Archive file format is, the
file type of the last analysis”
Excel? ..
R? .. MathCad ?..
Field
notebook
Is this your scientist’s
Data Management Reality?
.. Word ! “Processing log is:
notebook or email diary”
.. Word !
Is this your IT Dept’s
Data Management Reality?
“We can’t control data if it is on
another organisation’s systems”
Is this Your
Funder’s View?
The scientist in the
complex real world ...
“Archiving is a back-end
service of annotated
versioned files”
K-Excel &.
.. K-Word ! “Processing is K-wave scripted,
grid-enabled, shareable &
publishable for access anywhere”
.. K-Word !
“Staff in other organisations
have controlled access to
our in-house systems“
The IT Dept’s
NZ-science Club
Stakeholders as on-line
participants in NZ Science
The Scientist in the
complex real world ...
The IT
Dept’s
NZ-science
Club
PART 3 .. Future perspective
PART 2 .. Fast forward to 2013
POLICY+ DATA+ MAPPING+
PART 1 .. Data & Policy 2010
POLICY+
POLICY+ pivotal events in 2010
… that influenced data investment behaviour
• New Zealand Government Open Access and Licensing (NZGOAL)
• MoRST Environmental Data Management Policy Statement
• Significant $$s moved from vote Environment to vote Science
to do targeted research to enhance LCDB data-product &
deliver LCDB3 & LCDB4 as by-products of Kyoto imagery
POLICY
CYCLE
DIGITAL DATA
GROWTH
DATA+
http://lris.scinfo.org.nz
• Launched August 2010
• Data download focus
• Minimal visualisation capability
• Aimed at GIS professionals
• Requires registration
• Uses existing open source technologies
• Strong standards-based metadata component
• Many formats supported and different projections
• Web services
• Catalogue Service - linked to data.govt.nz, GEOSS
• WFS – Simple features
• Potential for user uploads and user comments
http://lris.scinfo.org.nz
DATA+
not just Landcare Research
… but also linz data service,
niwa environmental information catalogue
and data.govt.nz – which harvests these catalogues
MAPPING+
Principles
• K.I.S.S.
• Focus more on presenting knowledge and information
rather than data(sets)
– Inform users, assist in their understanding
– Not “just” maps
• Goal-based design – users with questions they want
answered
• Re-usable – both software and data/map layers
• Extensible
• Implemented using open source software
• Built on best practice and open standards
http://smap.landcareresearch.co.nz
First of the new portals
• Home page with good explanatory information
• Google maps-like navigation
• Reusable BASE layers from LINZ topographic data
• High quality on-screen cartography
• Speed of map redraws/zooms/pans
• Search by coordinates/location/address
• Use of metadata, legends and explanatory information
to inform user
• Reuses existing link to soil fact sheets generator
• High quality hard copy cartography (PDF)
http://ourenvironment.scinfo.org.nz
Second of the new portals
• S-map like features +
• Targeted at interested lay person but of value to
scientist also
• Information pop-ups instead of factsheets
• Where available, links to LRIS data layers
• Reuses BASE layers and context layers
• More extensive metadata, legends and
explanatory information to inform user
• Starts to introduce data visualisation & reporting
• Roadmap for further development
MAPPING+
each portal is tailored for a specific audience
… are your needs catered for?
come and talk to us
PART 3 .. Future perspective
WEB-SERVICES+
+ BIG-DATA POLICY++
PART 2 .. Fast forward to 2013
PART 1 .. Data & Policy 2010
WEB-SERVICES+
Our
Environment
Portal
Data ware-house
Databases
User Interactions
Web Data Service
Web Map Service
Data Access
Files
Gateway
to outside LCR
S-Map
Portal
Data Access
Data bus
Internet
Data Access
Web Catalogue
Service
DATA+ and MAPPING+ content …
LRIS
Portal
3rd Party
Web-sites
User’s
software
also available as
WEB-
SERVICES+
3rd Party
Web-sites
maps.scinfo.org.nz
WEB-SERVICES+
not just Landcare Research
… but also gns web-services & niwa web-services
and horizons.govt.nz with other RCs
+ BIG DATA
BIG-DATA … what is it?
Not large homogeneous data sets
Rather a fire-hose of diverse data from
real-time internet usage &
web-service data feeds
With potential for real-time feedback to
influence individual decision-making
eg via smart-phone
BIG-DATA … for example
How should I travel to a cross-city appointment?
walk, jog, bicycle, public transport, car or combination
web-service analyses routes based on: current gps position;
appointment address & time; real-time feeds of traffic flows,
public transport bus and train locations, routes & timetables;
green-bike usage patterns & availability; congestion statistics
during the trip; and … relative risks of being late
app consumes web-service & advises fastest, cheapest,
personal fitness target &/or greenest options which update
continuously as travel progresses & situation changes
Social Behavioural Big-Data
Spanish credit-card spending Easter 2011
POLICY
CYCLE
DIGITAL DATA
GROWTH
Social Behaviour Big-Data with
Environmental Impact … 201?
What if data is available real-time &
instead of matching $ transactions with
Groceries, Fuel, Fashion and Bars & Restaurants
… we match $ transactions against
map of embodied energy footprint, or
map of employment impact, or
health outcome alternatives, or
balance of trade impact … or ?
How would … this impact
policy formulation ? or
policy review ?
Environmental Big-Data … 20??
There are many private sensors in the environment
eg soil moisture for irrigation control or
heavy farm equipment monitoring to schedule maintenance
but is the data available?
… should it be as proof of ‘license to operate’
… what policy would encourage or mandate availability
… how would this influence world perception of
‘NZ 100% Pure’ ?