Project co-PI

Collaborator

CUAHSI Hydrologic Information System

Meeting Agenda• Monday

– 8:30 to 10 Project Overview

– 10:30 – noon Project PIs

– Lunch provided here– 1-3 Live HIS demos– 3:30 – 5PM

Discussion and feedback, User Assessment

• Tuesday– 8:30 – 10AM Summary of

User Assessment– 10:30 – noon Related

programs– 1-3 National data sets– 3:30 – 5PM Other projects

related to HIS

• Wednesday --Training– Hydrologic Digital Library– Digital Watershed

DataHypotheses

Needs

Tools

Data

Models

Exogenous DataTechnologicalAdvances

CommunitySupport

Multi-DisciplinaryTeams

HydrologicSynthesis

HydrologicObservatories

MeasurementTechnology

HydrologicInformation

Systems

CommunitySupport

AdditionalHypotheses

CUAHSI Hydrologic Information Systems

Environmental Cyberinfrastructure

• Part of NSF Cyberinfrastructure program

• Special emphasis on environmental sciences fostered by Margaret Leinen (Asst Dir for GeoSciences)

• CUAHSI Hydrologic Information Systems is one of several pilot projects

• Contains documents, datasets, tools, presentations, tutorials

• More data at ftp sites linked to CD

• http:// links to project websites at individual universities

Link to CD

Hydrologic Information System

1. Hydrologic Observations Database

Hydrologic SystemSensing

Recording

Transmission

Editing Storage

Retrieval

Sampling

Transmission

Laboratory Analysis

Recording

On-Site Measurement

Off-Site Measurement

Hydrologic Observations Database

• A relational database stored in Access, PostgreSQL, SQL/Server, ….

• Stores observation data made at points

• Access data through web interfaces

• Fill using automated data harvesting

Streamflow

Flux towerdata

Precipitation& Climate

Groundwaterlevels

Water Quality

Soil moisture

data

Space, L

Time, T

Variables, V

D

Data Cube

Space, FeatureID

Time, TSDateTime

Variables, TSTypeID

TSValue

Data Cube in Arc Hydro

Geospatial Time Series

Value

Time

Shape

Time SeriesProperties

(Type)A Value-Time array

A time series that knows what geographic feature it describes and what type of time series it is

ArcIMS Website for hydrologic observational data

Neuse basin

Thanks to ESRISan Antonio

Output from the ArcIMS website

Data open directly in Excel

Database Design

Relationships

Automated Data Harvesting

• Begin with a site file showing where data are available

• Develop automated harvesting tools to ingest observations from agency websites

• John Helly has done this for the NWIS data

NWIS Surface Water Sites(Ken Lanfear)

ACIS Climate Stations(Bill Noon)

Geostatistics

Time Series Analysis

Multivariate analysis

D

Hydrologic Statistics

How do we understand space-time correlation fields of many variables?

Upmanu Lallis our expert inthis area

Aquatic Ecology• What kind of

ecological observation data should we be collecting?

• What kind of HIS does an aquatic ecologist need?

• LeRoy Poff is our expert in this area

Hydrology

Ecology Geomorphology

Some Conclusions• Hydrologic Observations Database design works

and is ready for independent review and testing• Automated data harvesting may produce a “one

stop shop” for observational data• There will never be enough database fields to

describe all we want to know about data• We need a hybrid database—files solution

– This is what the San Diego Supercomputer Center is doing for us

Relationaldatabase

“Pile of files”

Hydrologic Information System

Sensor Network Interfaces to Digital Library

Example is for wireless network in Santa Margarita watershed, San Diego

John Helly is our expert in this subject!

21

HydroViewer Provides Access to…

Neuse Watershed Collection

Santa Margarita Watershed

Collection+ your Hydrologic Observatory Data Collection

http://cuahsi.sdsc.edu

CUAHSILink enables ArcMap to read files directly from the DigitalLibrary through an application programming interface

23

New Concept of PublicationHydrologic

Digital LibraryNormal Method +

Page 3

Drexel University, College of Engineering

Data Centers

NCDC

USGSNWIS

NCEP

NWS NGDC

Sensor Arrays

Numerical ModelsPrediction

HSPF

Air-Q

MM5

IndividualSamples

METADATA

The Demands

Page 10

Drexel University, College of Engineering

Ontologies for Metadata Profile

Hydrologic OntologyHydrologic Ontology

Hydrologic Metadata

A consistent suite of geographic information schemata that will allow Geographic informationto be integrated with information technology.ISO norm 19115.

www.isotc211.org

Hydrologic MetadataHydrologic Metadata Semantic WEB

Definition: The Semantic Web is the representation of data on the World Wide Web. It is basedon the Resource DescriptionFramework (RDF), which integrates a variety of applications usingXML for syntax and URIs for naming.

http://www.w3.org/2001/sw/

"The Semantic Web is an extension of the current web in which information is given well-defined meaning, better enabling computers and people to work in cooperation."

Semantic WEBSemantic WEB

Prepare the CUAHSIMetadata Profilefor the Future!

ISO 19103 Units/Conversion

Page 21

Drexel University, College of Engineering

Ontology Examples

More Ontologies

We currently have

ISO 19108 Temporal Objects

USGS Hydrologic Unit CodeISO 19115 Geospatial

Hydrologic ProcessesSedimentation

ARCHydro

What we need is

Many More

Many More

Many More

Many More

Upper Hydrologic Ontology

Michael Piasecki is ourexpert in this subject!

Hydrologic Information System

2. Hydrologic Representation

Hydrologic Observation

Data

GeospatialData

Remote SensingData

Weather and ClimateData

(NetCDF)

(GIS)(Relational database

or delimited ascii)

(EOS-HDF)

Digital Watershed

Hydrologic Data Model

Hydrologic Fluxes and Flows

Digital Watershed(Atmospheric, surface and subsurface water)

We need to represent the physical environment and water flowing through it

Created first for the Neuse basin

Digital Watershed:An implementation of the CUAHSI Hydrologic Data

Model for a particular region

Neuse Atmospheric Water• Daily precipitation

data from NCDC gages

• Nexrad daily rainfall rasters

• Land surface – atmosphere fluxes from North American Regional Reanalysis of climate

Neuse Surface Water• Streamflow, water quality

hydrologic observational data

• GIS: River network, water bodies, watersheds, monitoring points

• Land cover, soils, • MODIS remote sensing

(Praveen Kumar)

MODIS

Terrain and Land Cover

ArcIMS Web Server displaying data compiled in Neuse HO Planning Study

http://neuse.crwr.utexas.edu/

Neuse Basin: Coastal aquifer system

* From USGS, Water Resources Data Report of North Carolina for WY 2002

Section line

Beaufort Aquifer

Neuse Groundwater

Geovolumes of hydrogeologic unitsfrom US Geological survey (GMS)

Create a 3 dimensional representation

Geovolume

Each cell in the 2D representation is transformed

into a 3D object

Geovolume with model cells

HIS-USA• Base map information for

building digital watersheds anywhere in the US

• Hydrologic Observatory regions

• Monitoring site files• National river network

connected to HUC watersheds

• Hydrologic landscape regions

Hydrologic Information System

3.Hydrologic Analysis

HydrologicProcess Modeling

Statistics andHypothesis Testing

Visualization Data Miningand Knowledge Discovery

Digital Watershed

Data Driven

DiscoveryTools

Praveen Kumar is ourexpert on this subject!

Data Files

FebJan

4-D Data Model

Space, L

Time, T

Variables, V

D

Geostatistics

Time Series Analysis

Multivariate analysis

D

Image to Knowledge

Data to Knowledge

Hydrologic Flux Coupler

Hydrologic Fluxes and Flows

Digital Watershed(Atmospheric, surface and subsurface water)

We want to do water,mass, energy and water balances

Neuse Observatory Prototype Study

HydroVolumes

Take a watershed and extrude it vertically into the atmosphereand subsurface

A hydrovolume is “a volume in space through which water, energy and mass flow, are stored internally, and transformed”

Watershed Hydrovolumes

Geovolume is theportion of a hydrovolumethat contains solidearth materials

USGS Gaging stations

Hydrovolume

Stream channel Hydrovolumes

Continuous Space Data Model -- NetCDF

Space, L

Time, T

Variables, V

D

Coordinate dimensions

{X}

Variable dimensions{Y}

Space, FeatureID

Time, TSDateTime

Variables, TSTypeID

TSValue

Discrete Space-Time Data Model

Flux Coupling Table

96239748

9749

9614

All Hydrofeatures have a unique HydroID

Flux and flow data

Coupling table links all features that haveflux and flow data needed for the water balance

Flows and Fluxes

P, E, RQ

Net Inflow and Cumulative Storage

Net Inflow

Storage

This water balance does not close very well – we need better data!

Monthly water balance for one watershed hydrovolume for 2001

Hydrologic Information System

Modeling

A combination of geospatial and temporal hydrologic information which supports analysis, modeling and decision making

Interfacedata models

HMS

RAS

Modflow

GIS

GeoDatabase

Arc Hydrodata model

Connecting Arc Hydro and Hydrologic Models

This requires time series data bridgesbetween geodatabase and binaryfiles for hydrologic models

Conclusions• Hydrologic Observations Database and

Hydrologic Digital Library are functional and reading for testing

• Digital Watershed for Neuse has been built and can be expanded– we’d be pleased to work with other

Observatory teams to help them build a Digital Watershed

• Work on hydrologic flux coupler is developing