Raster data in GeoServer and GeoTools: Achievements, issues and future developments

Raster data in GeoServer and GeoTools: Achievements, issues and future developments

Ing. Simone Giannecchini, GeoSolutionsIng. Andrea Aime, GeoSolutions

FOSS4G 2014, Portland8th-13th September 2014

Outline

Who we are

The building blocks

Recent Achievements

What’s cooking


GeoSolutions

Founded in Italy in late 2006 Expertise

• Image Processing, GeoSpatial Data Fusion

• Java, Java Enterprise, C++, Python

• JPEG2000, JPIP, Advanced 2D visualization

Supporting/Developing FOSS4G projects MapStore, GeoServer

GeoBatch, GeoNetwork

Clients Public Agencies

Private Companies

http://www.geo-solutions.itFOSS4G 2014, Portland8th-13th September 2014

http://www.geo-solutions.it/

The technology stack


GeoServer building blocks

GeoTools

JTSImageIO(-Ext)

GDAL

WCS

JAI(-Ext)

WMS WFS WPS REST Google

Sp

ring

Vector Raster

GWC

Style

Kakadu JAITools


JAI

Java Advanced Imaging Library SUN then Oracle Image Processing library Huge number of basic building operations Tile-based, deferred execution model Integrate Tile Caching (In Memory) Easily Extensible Natively Accelerated Code available for many

operations No source code for native ops Development more or less stopped!


JAI-Ext

Oracle JAI Drop-In Replacement Open Source (Apache 2.0) High Performance Pure Java Support for No-Data Support for Processing ROI Several fixes compared to JAI Support for Band Masks


JAI-Ext

Operations Mosaic

Scale Affine Translate Lookup Algebra BandMerge BandSelect Border Buffer

Crop SquareRoot Stats Warp ZonalStats

High scalability support Op. registry Tile cache Tile scheduler


JAITools/Jiffle

High performance raster processing Extends, complements, replaces Oracle Java Advanced

Imaging (JAI) Library

Open Source, BSD license

Low Level Operations, e.g. RangeLookup

Higher Level Operations Vectorize, Contour

Raster algebra (Jiffle)

Works mostly in pure raster space (Image Processing)

Stable release is 1.3.0


ImageIO

SUN then Oracle Image I/O library Partly ships with JDK partly as extension Tile-based, deferred & immediate execution model Easily Extensible Natively Accelerated Code available for many

formats No source code for native (de)coders Development more or less stopped!


ImageIO-Ext

High Performance raster I/O Extends, complements, replaces Oracle JAI ImageIO

Library Open Source, LGPL and BSD licenses

Plugins: BigTiff*, MatFile 5, TurboJPEG JP2000 (Kakadu)

GDAL integration via ImageIO-ext JPEG2000, MrSID, ECW BigTIFF, ERDAS Image, HDF4 Complete list here


http://java.net/downloads/imageio-ext/Documentation/gdalsupportedformats.html

GeoTools

The Open Source Java GIS Toolkit

LGPL

Management of Geospatial data

CRUD Operations

Raster and vector

Rendering

GDAL Support

Based on best-of-breed Open Source projects

Java Advanced Imaging (JAI), ImageIO, ImageIO-Ext, JAITools (soon JAI-Ext too)

Java Topology Suite (JTS)FOSS4G 2014, Portland8th-13th September 2014

GeoServer

GeoSpatial enterprise gateway Java Enterprise Management of raster and vector data Based on GeoTools

Standards compliant OGC WCS 1.0, 1.1.1 (RI), 2.0.1 OGC WFS 1.0, 1.1 (RI), 2.0 OGC WMS 1.1.1, 1.3.0 OGC WPS 1.0.0 OGC CSW 2.0.2

Google Earth/Maps supportFOSS4G 2014, Portland8th-13th September 2014

Recent Achievements


GS – Faster PNG encoding

High Performance/Pure Java PNG output format

More Control on bugs/enhancements


Based on the open source PNGJ library

Optimized pixel extraction to PNG data buffer code

GS – raster projection handling

Better polar projection support


GS – raster projection handling

Rasters crossing dateline


GT – image mosaic masks

Support for vector masks as shp/wkb/wkt


GT – image mosaic masks

Also useful for clipping over a certain area E.g., clip over administrative boundaries


GS – WCS 2.0

WCS 2.0 The basics

Core service KVP binding XML binding

GetCoverage extensions CRS Scaling Interpolation Range subsetting GeoTiff GML NetCDF

Output format extensions GeoTIFF GML Grid NetCDF

Ensure CITE tests compliancy


GS – WCS 2.0

Processing Chain Crop

RangeSubset

Scale & Interpolate

Reproject & Interpolate

Encode

Core

Extension

Extension

Extension

Extension


GS – WCS-EO

WCS Earth Observation profile Build on top of a working WCS 2.0 with full extensions

WCS 2.0 CRS extension Range subsetting extension Interpolation extension Scaling extension GeoTiff extension NetCDF extension

Add support for the WCS-EO extras Listing coverage datasets in the capabilities documents (based on image

mosaic contents, which will have to be marked as “exposed” so that we show their inner structure for EO)

Support describe coverage dataset Support returning results for an entire dataset in GetCoverage


GS – Coverage Views

Virtual layers created merging bands from different sources


GS – Coverage Views


GT – NetCDF and Grib

NetCDF/Grib official Support Based on Unidata NetCDF JAVA library Exposes current interfaces (GridCoverage2DReader,

…) too for GeoServer compatibility before changes 1 coverage for each Dataset’s variable (multiple

coverages). Internal data exposed as set of 2D slices Custom dimensions support Ancillary XML file:

filter on NetCDF variables/coverages define low level index schema (for dimensions)


http://www.unidata.ucar.edu/software/thredds/current/netcdf-java/




ImageMosaic NetCDF/GRIB integration Allow the ImageMosaic to handle NetCDF/GRIB files

Expose NetCDF/GRIB internal structure (times, elevations)

Make ImageMosaic handle slices of the source files as granules

Mosaic

NetCDF 1 NetCDF 2 NetCDF … N

…

GT – NetCDF and GRIB


GT – NetCDF and GRIB

NetCDF Polyphemus Sample Dataset


GT – MulticoverageMultidimentional interfaces

StructuredGridCoverage2DReader exposes the underlying granule structure and dimensions

descriptors of a specific coverage getGranules (return a GranuleSource) getDimensionDescriptors

allows to create/remove coverages and add new sources createCoverage removeCoverage Harvest GetGranules


GS –multiple coverages per store

Multiple Coverages from Mosaic, NetCDF, GRIB


GT – access mosaic contents

GranuleSource/GranuleStore GranuleSource:

ReadOnly access to Granules (with Query support) getGranules(Query) SimpleFeatureCollection getSchema SimpleFeatureType getCount(Query), getBounds(Query)

E.g.: get all granules having acquisitionYear > 2012 and Country=Italy GranuleStore:

add/modify/delete capabilities using Transactions addGranules (SimpleFeatureCollection) removeGranules (Filter) updateGranules

E.g.: remove all granules having acquisitionYear < 1990


GS – REST over mosaic contents

Granule Index CRUD Operations via REST CREATEcurl -u admin:Geos -XPUT -H "Content-type:application/zip" --data-binary @http://localhost:8080/geoserver/rest/workspaces/geosolutions/coveragestores/temperature/file.imagemosaic

READ index schemacurl -v -u admin:Geos -XGET "http://localhost:8080/geoserver/rest/workspaces/geosolutions/coveragestores/polyphemus/coverages/NO2/index.xml"

READ AND FILTER WFS like with CQL filtering and paging

curl -v -u admin:Geos -XGET "http://localhost:8080/geoserver/rest/workspaces/geosolutions/coveragestores/polyphemus/coverages/NO2/index/granules.xml?limit=1&filter=time='2013-03-03T00:00:00Z'"


GS – REST over mosaic contents

Granule Index CRUD Operations via REST UPDATE

curl -v -u admin:Geos -XPOST -H "Content-type: text/plain" -d "/polyphemus_20130303.nc" "http://localhost:8080/geoserver/rest/workspaces/geosolutions/coveragestores/polyphemus/external.imagemosaic"

DELETE WFS like with CQL filtering and paging or by ID

curl -v -u admin:geoserver -XDELETE "http://localhost:8080/geoserver/rest/workspaces/topp/coveragestores/polyphemus-v1/coverages/NO2/index/granules.xml?filter=location='polyphemus_20130301.nc'"

curl -v -u admin:geoserver -XGET "http://localhost:8080/geoserver/rest/workspaces/topp/coveragestores/polyphemus-v1/coverages/NO2/index/granules/NO2.2689.xml"


GS – WCS NetCDF out

NetCDF Output Format GetCoverage request parameter: &Format=NetCDF Based on Unidata NetCDF JAVA library Create a NetCDF output file on top of a GranuleStack:

A GridCoverage2D List: a GridCoverage2D for each combination of requested

Dimension values GridCoverages should come from a

StructuredGridCoverage2DReader Supports WCS 2.0.1

Trimming: specify values range for a dimension Slicing: specify single value for a dimension

Supports timeRanges/numberRanges on output






GS – WCS NetCDF out

Sample WCS request

http://localhost:8080/geoserver/wcs?request=GetCoverage&service=WCS&version=2.0.1&coverageId=geosolutions__NO2&Format=NetCDF&subset=http://www.opengis.net/def/axis/OGC/0/Long(5,20)&subset=http://www.opengis.net/def/axis/OGC/0/Lat(40,50)&subset=http://www.opengis.net/def/axis/OGC/0/elevation (300,1250)&subset=http://www.opengis.net/def/axis/OGC/0/time ("2013-03-01T10:00:00.000Z","2013-03-01T22:00:00.000Z")


http://localhost:8080/geoserver/wcs?request=GetCoverage&service=WCS&version=2.0.1&coverageId=geosolutions__NO2



GS – NetCDF out in ToolsUI

FOSS4G 2013, Nottingham21th September 2013

GS – WMS EO

Extending LayerGroup concept

Support same style on both raster and vector

data

Support custom dimensions

Alter map on the fly to support band combination

Wizard to configure EO layer groups

Earth observation profile GSIP 84


http://geoserver.org/display/GEOS/GSIP+84+-+Control+how+layer+groups+are+exposed+in+the+WMS+capabilities+document

GS – WMS-EO

WMS-EO Quirks Root layer must respond with a specific layer rather than

the composition of the children Kind of a default visualization for a certain Dataset

E.g. when I send a GetMap for the root layer I could get back the browse image default layer

Same styles for both Raster as well as Vector data E.g. yellow can be use for both flags as well as outlines

Peculiar behavior for Band layer ( raw data ) E.g. multiple bands at different wavelengths

Can request either 1 (grayscale image) or 3 (RGB image)

Different combinations are prohibited

Peculiar Behavior for GetFeatureInfo


GS – dynamic color map


QGISpalettes

GDAL pam stats

Inputraster

DynamicColorMap Map!

What’s cookingPlus what’s on our wish list


NODATA support

Natively handle NODATA with JAI-EXT Support in all aspects

Scaling Reprojection Interpolation


GS – Raster algebra WPS

Raster Algebra as WPS Gets an OGC Filter containing logical operations between

raster layers and produces a binary (0/1) layer


GS – Raster algebra in Coverage views

JIFFLE


GS – Raster algebra in Coverage Views

Define new bands using a Jiffle formula Generate fully computed layers Still using overviews and other native

abilities


The End

[email protected]

[email protected]


Old news


ImageIO-Ext

LibJPEG-Turbo derivative library of libjpeg based on SIMD

instructions (MMX, SSE2, NEON) accelerate baseline JPEG compression and

decompression on x86, x86-64, and ARM systems available on many platforms Open Source, LGPL

ImageIO-Ext-TurboJPEG A JPEG ImageIO plugin built on top of the JAVA

wrapper for LibJPEG-Turbo (TurboJPEG) 20%-30% SpeedUp* on JPEG encoding 10%-20% SpeedUp* on JPEG decoding More info here Integrates with TIFF reader and writer


https://sourceforge.net/projects/libjpeg-turbo/

https://sourceforge.net/projects/libjpeg-turbo/

http://www.libjpeg-turbo.org/About/TurboJPEG

http://www.libjpeg-turbo.org/About/Performance

ImageIO-Ext

NITF encoding Support (ImageIO-Ext-NITF) Based on NITRO Support for Tagged Record Extensions (TREs) Support ImageSegments JPEG2000 compression through

Kakadu ImageIO-Ext plugin (Numerically Lossless/VisuallyLossless/Lossy) NPJE, EPJE BIIF (Basic Image Interchange Format) profiles J2KLRA TRE support

Support for multiple TextSegments Support for multiple ImageSegments Support for ShapeFile Data Extension Segment (CSSHPA)


http://sourceforge.net/projects/nitro-nitf/

GeoTools

Band Combine + Symbology

Raster to point vector

On-the-fly Contouring

On-the-fly Polygonalization

Improved internal JAI Concurrency Introduced and Improved JAI Tile Recycling Reduced depth of JAI Processing Chains More aggressive factory caching Added a few specific high perf JAI operations

e.g. crop Created Specific high perf ROI class Improving Tile Caching

Work ongoing Transparent File vs Memory Caching when writing

raster


GeoTools

Optimized Rendering/Processing for raster data Optimized Crop Chains Coalescing multiple Crops into a

single one Optimize Affine Transformation Chains Coalescing

multiple Affine Transformations into a single one

NEAREST


GeoTools

BICUBIC


GeoTools

ImageMosaic Custom Dimensions

More than simple time/elevation support E.g.: wavelength, cloudLevel, …

Dimensions with ranges: (startTime, endTime), (minElevation,maxElevation), …

Dynamic read parameters Filtering

Supports for OGC Filters through the “filter” param E.g.: Return only ImageMosaic granules where

attribute Country = Italy. filter=“Country=‘Italy’ ”


ImageMosaic

Custom/Additional dimensions


GeoTools

ImageMosaic Ordering

SORT_BY clause support on DBMS based mosaics sorting=“time A, elevation D”

Stacking VS Merging Merging: different granules merged together in

the final image as default Stacking: different granules stacked on different

bands E.g. MeteoSat data: 12 channels (1 granule for each Channel)

1 = VIS0.6, 2 = VIS0.8, …, 11 = IR13.4, 12 = HRV. Want return a RGB image made of channels 1,3,7 Stack

them


GeoTools

New API (unsupported/coverage-experiment) Driver: Get a connection to a coverage store. CoverageAccess: a physical storage of coverage data. Get access

to a source of coverages. CoverageSource: provides data access to a coverage.

Updated GridCoverage core API Old GridCoverageReader:

inefficient and thread unsafe way to access multiple coverages read GridCoverages from the input stream in a sequential order

New GridCoverage2DReader: Coverages and properties may be accessed by coverage name:

get Envelope(name), get GridRange(name), get CRS(name), read(name), get dynamicParameters (name), …

dynamicParameters support (for custom dimensions)


GeoServer

LibJPEG-Turbo Output format Encoding WMS output JPEG images through

LibJPEG Turbo library Based on the TurboJpeg ImageIO-Ext plugin built

on top of the JAVA interface for LibJPEG-Turbo (TurboJPEG)

Provided as a GeoServer extension Up to 80% SpeedUp measured on JPEG encoding Can be disabled at startup:

-Ddisable.turbojpeg=true More Info here


http://www.libjpeg-turbo.org/About/TurboJPEG

http://gridlock.opengeo.org/geoserver/trunk/community-latest/geoserver-2.5-SNAPSHOT-libjpeg-turbo-plugin.zip

http://geo-solutions.blogspot.co.uk/2013/03/libjpeg-turbo.html

GeoServer

More Color Quantizers

Speed loss is around 10%

OCTTREE

MEDIANCUT


GeoServer

WMS Custom Dimensions Work on GeoTools raster Additional Domains

NetCDF ImageMosaic

Turn additional querying dimensions into WCS/WMS Dimensions

ImageMosaic Domain Category WMS 1.1.1 DIM_CATEGORY WMS 1.3.0 DIM_CATEGORY

Perfect for large multidimensional mosaics! E.g. meteo (forecast time, elevation, band, base

time, model name)


GeoServer

WMS TIME, ELEVATION & Morehttp://localhost:8080/geoserver/geosolutions/wms?...&time=2013-03-01T00:00:00.000Z&elevation=35.0&DIM_FILEDATE=2013-03-01T00:00:00.000Z&DIM_UPDATED=2013-04-08T08:18:41.597Z


Technology

Raster data in GeoServer and GeoTools: Achievements, issues and future developments