Automating Model Skill Assessmentwith Python

Rich Signell (USGS, Woods Hole, MA)Filipe Fernandes (SECOORA)

Kyle Wilcox (Axiom Data Science, Wickford, RI)

CEOS WGISS Tech Expo Webinar 2017-08-22

US Integrated Ocean Observing System (IOOS®)

IOOS® Plan defines:• Global Component• Coastal Component

▪ 17 Federal Agencies▪ 11 Regional Associations

IOOS Recommended Web Servicesand Data Encodings

IOOS Model Data Interoperability Design

ROMS

ADCIRC

HYCOM

SELFE

SLOSH NcML

NcML

NcML

NcML

Common Data Model

OPeNDAP+CF+UGRID|SGRID

WCS

NetCDF Subset

THREDDS Data Server (TDS)

Standardized (CF-1.6, UGRID-1.0, SGRID-0.3) Virtual Datasets

NonstandardModel Output Data Files

Web ServicesMatlab

Panoply

IDV

Clients

NetCDF-Java

Libraryor Broker

WMS

ncISO

ArcGISNetCDF4-Python

FVCOM

PythonERDDAP

NetCDF-Java

SOS

Geoportal Server

GeoNetwork

GI-CAT

Observed data (buoy, gauge, ADCP, glider)

Godiva2

pycsw-CKAN

NcML

GridSgridUgridTimeSeriesProfileTrajectoryTimeSeriesProfile

NonstandardData Files

CatalogServices

CMG Portal

Delft3D NcML

sudo apt-get dockerdocker run –d unidata/thredds-docker

IOOS Catalog

5

Interoperable Access in Python (Iris)

Boston Light Swim

8 mile swimNo wet suitHow cold will the water be?

Boston Light Swim Paper

Demo

Conda-Forge is Awesome

2900+ packages and growing!

Summary

• Standardized framework makes skill assessment easy and powerful

• Services are now easy to install and maintain• Skill assessment notebooks are reproducible

by others (for free)• More assessment leads to more appropriate

use of modeling products• More assessment of models leads to better

models

Demo

Boston Light Swim Notebook