Embed Size (px)
DESCRIPTION
5-minute intro to Stetl an Open Source lightweight framework for handling the conversion and transformation (ETL) of in particular complex/rich GML. Stetl uses and combines existing tools like GDAL/OGR and XSLT. Python is used as glue. Users configure an ETL-process chain through a configuration. More at http://stetl.org
Citation preview
Taming Rich GMLwith Stetl
Just van den Broecke5 minute presentation at OSGeo.nl Stammtisch Wageningen
November 7, 2012www.osgeo.nl
www.justobjects.nl
We have a Problem
The Rich GML Problem
Rich GML = Complex Mess
INSPIREBAGBGT
Top10NL.
The Streetname!
Complex Model
Transformations
Millionsof
Objects
10s of Millionsof
<Elements>
MultipleTransformation
Steps
Solution is Spatial ETL
A.K.A.
Thank You for your
Attention!
But.......FOSS ? ... Stetl...?
FOSS ETL - High Level
FOSS ETL - Lower Level
But Each Powerful by Itself
ogr2ogr
FOSS ETL - DIY ? (No!)
FOSS ETL - How to Combine?
=+ + ?ogr2ogr
FOSS ETL - Add Python to Equation
=+ + ?( )ogr2ogr
=+ +
Stetl
( )ogr2ogr
Stetl=
SimpleStreaming
SpatialSpeedy
ETL
Process Chain
Input Filter Outputgml
Filter
Speed: Streaming
Input Filter Outputgml
Speed: Going Native
Input Filter Outputgml
ogr2ogr stETL
Native C Libs/Progs
Calls
Example: GML to PostGIS
Reader XMLSplitter ogr2ogr
gml
Example: INSPIRE Model Transform
ogr2ogr XSLT Writergml
Example: deegree Store
ogr2ogr XSLT deegreeWriter
Process Chain - How?
Input Filters Output
Example: XML to Shape
The Source
Example: XML to Shape
First: XSLT Transform to GML
Example: XML to Shape
XMLInput XSLT ogr2ogr
Example: XML to Shape
The Stetl Chain Config File
ProcessChain
Reader
XSLT
ogr2ogr
