12
1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell NASA/GSFC [email protected] V

1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Embed Size (px)

Citation preview

Page 1: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

11

ECHO Overview and Status

Enabling Interoperability with NASA Earth Science Data and Services

GES DISC User Working Group May 10, 2011

Andrew E. MitchellNASA/[email protected]

Page 2: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Encouraging Partners and Brokers

ECHO is EOSDIS’s middleware layer between EOS data and science data users via a service-oriented architecture. Designed to improve the discovery and access of NASA data.

Acts as an order broker between end users and EOSDIS Data Centers who provide metadata for their EOS data holdings and other Earth science-related data holdings.

User-defined specialized “clients” can be easily developed to give science data users of their community access to EOS data and services using ECHO’s open APIs.

2

Developed as a part of

NASA’s core data systems

but fully adaptable to

the needs/requir

ements of science

communities.

Page 3: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

3

Current ECHO Data Partners

Data currently accessible in ECHO:

• Collections: 3,186

• Granules: 89 million

• Browse images: 43 million

EOSDIS Data Centers participating in ECHO• ASDC: Radiation Budget, Clouds, Aerosols and Tropospheric Chemistry

• ASF: Synthetic Aperture Radar (SAR), Sea Ice, Polar Processes, Geophysics

• GES DISC: Atmospheric Composition and Dynamics, Global Precipitation, Model Output, Solar Irradiance

• GHRC: Global Hydrology, Global Temperatures, and Lightning

• LP-DAAC: Land Processes

• NSIDC: Snow and Ice, Cryosphere and Climate

• ORNL: Biogeochemical Dynamics, Ecological Data, Environmental Processes

• PO-DAAC: Oceanic Processes, Air-Sea Interactions

• SEDAC: Population, Sustainability

Other EO Data Centers• USGS: Landsat

Page 4: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Metadata

4

Page 5: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

5

ECHO Client Partner Status

Current ECHO Clients• Variety of client types

• Web-based clients, Installed applications

• User interactive, machine-to-machine

• Variety of purposes• General purpose geospatial and temporal searching

• Customized user interfaces to facilitate specific communities and tasks

• Additional value-added processing by clients (e.g. subset, stitch, resample, reproject, reformat)

• Middleware components

Client Partner metrics (May 2011)

• Operational Public: 7• Active Development: 3

Page 6: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Warehouse Inventory Search Tool (WIST)

Provides search and order capabilities across the full set of data provider holdings in the ECHO catalogue.

One of the primary access points to EOSDIS and other Earth science data holdings

Users are able to submit cross-discipline queries using spatial and temporal criteria, examine search results for relevancy using built-in tools, and submit orders via ECHO to the appropriate data provider(s).

Based on the EOS Data Gateway (EDG) user interface

https://wist.echo.nasa.gov

6

Page 7: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Next Generation Client - REVERB

Provides search and order functionality built on the ECHO API that improves end user experience of the WIST client in user satisfaction and performance.

Exposes the ECHO service registry with relevant ECHO metadata and incorporate a modern dynamic user interface using current web development technology.

• Leverages newer technologies (Ruby on Rails web application framework) and performance enhancements

Operational Release May 2011

7

Page 8: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Reverb Overview

• New Paradigm• Utilize modern technology to provide an enhanced look & feel & improved sustainability• Utilize modern web standards including a new REST-based ECHO API• Provide an extendible platform that will allow for simpler incorporation of new user interfaces

capabilities.• Requirements

• Derived from WIST functionality, previous NCRs, and new enhancements.• Tracked entirely in TestTrack Pro

Improved Client Features• Enhance Dataset Discovery• Improve Search Criteria Entry & Validation• Utilize of Cloud Cover metadata value • Facilitate Bulk Download• Facilitate Service Discovery & Invocation• Utilize new Calendar API configured through PUMP• Utilize enhanced Data Quality Summaries configured through PUMP• Provide browse thumbnail images during browsing

Page 9: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

ESA’s eoPortal Catalogue - ECHO Client

Similar to WIST, the eoPortal Catalogue Client allows users to query Earth Science products from diverse data providers using spatial and temporal boundaries. Some of the catalogs currently represented in their client are NASA (via ECHO), German Space Agency (DLR), Korea Aerospace Research Institute (KARI), and the European Space Agency (ESA).

9

Page 10: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

ECHO and GCMD Interoperability

The GCMD ECHO Portal offers the users a virtual subset of the GCMD to gain direct access to granule-level data in ECHO.

• The GET DATA link sends a search to WIST based on the search criteria selected in the GCMD and automatically pre-populates the WIST form but does not execute the query.

ECHO adopted the GCMD Science Keyword structure for use in the ECHO metadata model

WIST and the ECHO-OpenSearch client reference GCMD Dataset Definitions.

10

Page 11: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

Recent ECHO Improvements

ECHO was re-architected to provide full redundancy of all critical components, virtually eliminating need for preventive maintenance downtime, and increased stability. Operational availability has been dramatically improved:

• Average operational availability over past 6 months: 99%

ECHO search performance has been significantly improved in the past 2 years: Average query time now 7 seconds (from 30 seconds)

Average Ingest performance improved by a factor of 10

ECHO is working to simplify efforts of Client developers:

• Added 2 new API formats: OpenSearch and REST

ECHO’s Ingest functionality is being enhanced to support multiple metadata formats including ISO 19115 and allowing the discovery of the catalog query results in these formats;

• Reverb will be able to output data in the ISO 19115 metadata standard.

11

Page 12: 1 1 ECHO Overview and Status Enabling Interoperability with NASA Earth Science Data and Services GES DISC User Working Group May 10, 2011 Andrew E. Mitchell

ECHO and the GES DISC

Reverb supports batch download of online data (w/o ordering)

• The critical ingredient for ECHO to be relevant to GES DISC users

• Also looks and works better than WIST

GES DISC is working on several clients through ECHO’s OpenSearch interface

• Mirador external search

• Simple Subset Wizard

• Community-based Giovanni

• Giovanni for YOTC

Also cooperating (with EED) on EOSDIS Service Interface

• Generalization of the Simple Subset Wizard agent interface

12