Demonstrating how to Implement INSPIRE Download Services
Debbie Wilson
Sunday 24th June – 16:00
Beylerbeyi Hall 1
Workshop Objectives• Provide overview of requirements of INSPIRE Download
Service Technical Guidance v3.0 (12th June 2012)• http://inspire.jrc.ec.europa.eu/documents/Network_Services/Technical_Guid
ance_Download_Services_3.0.pdf
• Practical Demonstration how to create and publish EEA Natura 2000 data (reported 2009) via each option:– ATOM Feed for pre-defined datasets– WFS for pre-defined datasets– WFS for pre-defined datasets and spatial objects (features)
INSPIRE Download ServicesTechnical Guidance
What is an INSPIRE Download Service? “mechanism by which users can access the information contained
within the spatial data set related to an Annex theme”
…enabling copies of spatial data sets, or parts of such sets, to be downloaded and, where practicable, accessed directly (INSPIRE Directive)
Types of INSPIRE Download Service1. Pre-Defined Download Service
– One or more files representing either the full dataset or subsets
– These files are accessed via a file or data repository (e.g. FTP)
– Downloaded in their entirety and the content cannot be changed (i.e. encoding, CRS)
2. Direct Access Download Service– Users define a set of request criteria that subsets the data to return only the
features needed:
• Select all data within a bounding box
• Select only feature type x and y
• Select feature by identifier
• Select all features that are valid between T1 and T2 within and area of interest
Non-Interoperable vs Interoperable Download Services1. Non-Interoperable : Provide access to your data as you provide it today
2. Interoperable : Data provided conforms to relevant INSPIRE data specification(s)
Deadline for Implementation
Annex I & II: 28th Dec 2012Annex III: 3rd Dec 2013
Technical Requirements
Implementing Rule and Technical Guidance
Legal Requirements for Download Services
Operation Type of Download Service
Get Download Service Metadata All
Get Spatial Dataset All
Describe Spatial Dataset All
Link Download Service All
Get Spatial Object* Direct Access
Describe Spatial Object Type Direct Access
• Get Spatial Object operation should support the following request criteria:
• Unique Resource Identifier
• CRS
• Filter expressions: logical, comparison, spatial (bbox), temporal
Mandatory Operations:
Legal Requirements for Download ServicesQuality of Service requirements:
QoS Operation Requirement
Performance Get Download Service Metadata
Initial response ≤ 10 seconds
Get Spatial Data Set/Get Spatial Object(BBOX request)
Initial response ≤ 30 seconds Then sustained response > 0.5 Mb/s or > 500 objects/sec.
Describe Spatial Data Set/Describe Spatial Object
Initial response ≤ 10 seconds Then sustained response > 0.5 Mb/s or > 500 objects/sec.
Capacity > 10 simultaneous requests per second. The number of requests processed in parallel may be limited to 50.
Availability Shall be available 99 % of the time.
Options for INSPIRE Download Services• 3 options for implementing INSPIRE Download Services*:
1. ATOM Feed providing access to pre-defined datasets
2. OGC WFS 2.0 serving pre-defined datasets
3. OGC WFS 2.0 serving features (Direct Access)
Conformance Class Obligation
1. Atom Feed C (M, if WFS (Predefined) is not
conformed to)
2. Pre-defined WFS C (M, if Atom Feed is not
conformed to)
3. Direct access WFS O
4. Quality of Service M
* Additional service types (e.g. OGC WCS/SOS) will be added once Annex II & III themes published
Demonstration:Implementing Interoperable INSPIRE Download Services
Scenario• Publish Natura 2000 data reported to EEA in 2009
• Data transformed into INSPIRE Annex I – Protected Sites Full Application Schema
• Demonstrate full process for implementing INSPIRE Download Service
Oracle XE
Publishing data via INSPIRE Download Services
Step 1
•Configure INSPIRE Download Service:•Define
chunking scheme for generating pre-defined datasets, if applicable (e.g. Country)
•Update schema transformation mapping
•Capabilities metadata
•Output format/deployment
Step 2
•Create INSPIRE ISO metadata:•Upda
te dataset metadata and create series metadata
•Create service metadata
Step 3
•Deploy Download Service and associated metadata
Step 4
•Publish metadata into INSPIRE Discovery Service
Publishing data via INSPIRE Download Services
Step 1
•Configure INSPIRE Download Service:•Define
chunking scheme for generating pre-defined datasets, if applicable (e.g. Country)
•Update schema transformation mapping
•Capabilities metadata
•Output format/deployment
Step 2
•Create INSPIRE ISO metadata:•Up
date dataset metadata and create service metadata
Step 3
•Deploy Download Service and associated metadata
Step 4
•Publish metadata into INSPIRE Discovery Service
Publishing data via INSPIRE Download Services
Step 1
•Configure INSPIRE Download Service:•Define
chunking scheme for generating pre-defined datasets, if applicable (e.g country)
•Update schema transformation mapping
•Capabilities metadata
•Output format/deployment
Step 2
•Create INSPIRE ISO metadata:•Up
date dataset metadata and create service metadata
Step 3
•Deploy INSPIRE Download Service and associated resources
Step 4
•Publish metadata into INSPIRE Discovery Service
Publishing data via INSPIRE Download Services
Step 1
•Configure INSPIRE Download Service:•Define
chunking scheme for generating pre-defined datasets, if applicable (e.g Country)
•Update schema transformation mapping
•Capabilities metadata
•Output format/deployment
Step 2
•Create INSPIRE ISO metadata:•Up
date dataset metadata and create service metadata
Step 3
•Deploy INSPIRE Download Service and associated resources
Step 4
•Publish metadata into INSPIRE Discovery Service
Schema Transformation
GO Publisher Desktop GO Publisher Agent GO Publisher WFS
Legacy Database Schema or
INSPIRE Database Schema
Metadata Dataset
describes
ATOM Feed
Dataset Feature
Direct Access WFS
Pre-defined WFS
Data & metadata
ATOM Feed
GO Publisher
Schema Transformation
GO Publisher Desktop
Legacy Database Schema or
INSPIRE Database Schema
Metadata Dataset
describes
ATOM Feed
GO Publisher
Schema Transformation
GO Publisher Desktop GO Publisher Agent
Legacy Database Schema or
INSPIRE Database Schema
Metadata Dataset
describes
ATOM Feed
Data & metadata
ATOM Feed
GO Publisher
Schema Transformation
GO Publisher Desktop GO Publisher Agent GO Publisher WFS
Legacy Database Schema or
INSPIRE Database Schema
Metadata Dataset
describes
ATOM Feed
Dataset Feature
Direct Access WFS
Pre-defined WFS
Data & metadata
ATOM Feed
GO Publisher
Demo 1: ATOM Feeds
ATOM Feeds
• XML based web content and metadata syndication format
• Application-level protocol for publishing and editing web resources belonging to periodically updated websites
• ATOM feeds push links to updated content to subscribed users
• Removes need for user to repeatedly return to source to check for updates
• Minimal implementation cost and complexity
Feed readers• To subscribe to ATOM Feeds you will need either:
1. Web Browser (e.g. Firefox, Opera, IE, Safari, Chrome)• Automatically check for feeds when you visit a website• Add feeds as a browser favourite or bookmark folder, automatically
updating them with the latest content
2. Web-based feed reader (e.g. Google Reader, Hootsuite)• User subscribes to feeds• Displays any new content as they are added
3. Desktop feed reader• Typically integrated into email (e.g. MS Outlook)• Displays any new content as they are added
Content of an ATOM Feed• An ATOM feed contains:
1. Descriptive metadata describing the feed itself
2. One or more entries that describes the content (i.e. pre-defined dataset)
INSPIRE Requirements for ATOM Feeds
Elements required to describe the feedBasic Descriptive Metadata:
Title ID Author
Links to related metadata and resources:
Update Rights(Top feed)
Subtitle GeoRSS polygon(Dataset Feed)
Spatial object description(Dataset Feed)
OpenSearch Description (Top Feed)
INSPIRE ISO Metadata
Service(Top Feed)
Dataset(Top Feed)
Self Referencing Link
Optional link to alternate representations of feed
(language, format)
Elements required to describe the feedBasic Descriptive Metadata:
Title ID Author
Links to related metadata and content:
Update Rights(Top feed)
Subtitle GeoRSS polygon(Dataset Feed)
Spatial object description(Dataset Feed)
OpenSearch Description (Top Feed)
INSPIRE ISO Metadata
Service(Top Feed)
Dataset(Top Feed)
Self Referencing Link
Optional link to alternate representations of feed
(language, format)
Each link requires the following attributes:
• @href: URL of resource
• @rel: relationship of resource
• @type: mime type
• @title: title use to describe linked resource (optional)
• @hreflang: language used in resource (optional)
Example: Top Level Download Service Feed
Example: Dataset Feed
Elements required to describe entries
Title ID
Author
Update
RightsSubtitleGeoRSS polygon
Category (CRS)(Dataset Feed)
Link(s) to Content
URL for Dataset Feed(Top Feed)
URL for Dataset(Dataset Feed)
Example: Entry in Top Level Feed
Example: Entry in Dataset Feed
Demo 1: ATOM Feeds
Workflow for Atom Feed INSPIRE Download Service
Publish Pre-defined Datasets
CRS: ETRS89
CRS: WGS84
Create ISO19139 Metadata (Data & Service)
Create ATOM feed(incl Open Search)
Demo 1: ATOM Feeds
Validating Metadata
Subscribing to Download Service feeds
Demo 2: Pre-defined and Direct Access WFS
OGC Web Feature Service• Web Feature Service is a much more sophisticated web
service for downloading and directly access data online• Supports the ability for users to retrieve only the data
they are interested in • An OGC Web Feature Service provides access to
features (aka INSPIRE spatial objects) not datasets.
OGC WFS must support Get Spatial Dataset operation
Must support Get DataSet By ID Stored Query
Optional support for ad hoc queries for user-defined queries
Conformance Classes for OGC WFS• INSPIRE Pre-Defined WFS Conformance Class :
– Implement ISO 19142 ‘Simple WFS’– Implement HTTP Get– Implement GetDatasetByID Stored Query– Implement INSPIRE Extended Capabilities
• Optionally support INSPIRE Direct Access Conformance Class:– Implement ISO 19142 ‘Basic WFS’– Separate endpoint shall be established for each INSPIRE dataset
Demo 2: Pre-defined and Direct Access WFS
Workflow for WFS INSPIRE Download Service
Configure mapping
Configure GetCapabilities
Create ISO19139 Service metadata
Generate WFS
Deploy WFSCreate Stored
QueryTest
Configuring the WFS• It’s really easy to configure the WFS to serve individual
features• Much more of a challenge to get the WFS to serve pre-
defined datasets• What should be the payload of response to the pre-
defined dataset Stored Query within WFS?• Protected Sites? Or• INSPIRE SpatialDataSet?
Awaiting clarification as no guidance in TG
Configuration OptionsOption 1: Set up the WFS as a Pre-Defined Download
Service only• Update mapping to publish Protected Sites contained within the
INSPIRE SpatialDataset
Pro’s Con’s
• Easy to set up • Cannot retrieve individual features
• GetCapabilities feature list contains on SpatialDatasets
Configuration OptionsOption 2: Configure WFS to serve both datasets and
features (Pre-defined & Direct Access WFS)• Protected Sites are configured as individual features• INSPIRE SpatialDataSet contains pre-defined set of Protected
Sites (via Xlink not inline)
Pro’s Con’s
• Supports ability to request both individual features and pre-defined datasets
• SpatialDataSet contains a list of identifiers to the individual features
• This list must be resolved in the response
• WFS should support resolve• Resolve should be a default parameter in
the GetDataSetByID stored query
Configuration OptionsOption 3: Configure WFS to serve only features• Define GetDatasetByID Stored Query to retrieve pre-defined
subset of features based on common property such as country code or geographic extent
• By publishing each dataset as a separate endpoint ensure dataset id are unique for each dataset
Pro’s
• Supports ability to request both individual features and pre-defined datasets
• Easy to set up
• Doesn’t require any complex WFS request parameters
Demo 2: Pre-defined and Direct Access WFS
Conclusion• There are currently three options for INSPIRE Download
Services:– Pre-defined Atom Feeds– Pre-defined WFS– Pre-defined WFS (& Direct Access WFS)
• Deadlines are soon for implementing your INSPIRE Download Service(s):– Annex I & II: 28th Dec 2012 (6 mths)– Annex III: 3rd Dec 2013 (18 mths)
• Tools are available now that implement the INSPIRE Download Service Technical Guidance