Metadata ImplementationTed HabermannNOAA National Geophysical Data Center

Documentation: It’s not just discovery...

50% change in global average

Why?i checked my 2002 email archives, and here is what i found out:

it appears that the current 3rd generation algorithm was implemented into operations around Oct-Nov 2002 time frame. cannot say more precisely, as all email correspondence i am looking at, talks about this indirectly. (maybe it's what's refered to as the Phase II algorithm.) At the same time, we had implemented quite a few other changes fixing data bugs and formats: view angle problem, increased digitization in all channel's reflectances and AODs, etc.

The jump is deemed due to introducing 3rd generation algorithm, which replaced the 2nd generation. The new numbers (~0.08) look more realistic than the previous ones (~0.05 or so). The changes seen in the data is close to the expected effect of this change. The 3rd gen alg takes into account the exact spectral response, whereas the 2nd gen is generic ("one size fits all").

hopefully this settles the issue..

New Documentation Needs

For skeptics, the 1,000 or so e-mails and documents hacked last year from the Climactic Research Unit of the University of East Anglia (UEA), in England, establish that global warming is a scientific conspiracy.

The climate scientists at the centre of a media storm over leaked emails were yesterday cleared of accusations that they fudged their results and silenced critics, but a review found they had failed to be open enough about their work.

Designated Communities - Users

Data preservation is communicating with the future

What Goes Where?

Spiral 1:Initial Content

Metadata ContentIndependent of standard

StandardGuidance /

Implementation

Check BackWith Users

Spiral 2-N: Scientific QuestionsNew RequirementsNew Use Cases

Check BackWith Data Collectors/

Providers

Spiral Development / Training

IdentificationIdTitleAbstractResource DateTopic CategoryTheme KeywordMetadata ContactScience Contact

ExtentGeospatial Bounding BoxTemporal Start/EndVertical Min/MaxPlace Keywords

DistributionDistributor ContactOnline ResourceDistribution FormatData Center KeywordsBrowse Graphic

Text SearchesPurposeExtent DescriptionLineage StatementProject Keywords

Quality/LineageSourcesProcess StepsQuality Reports / Coverages

Acquisition InformationInstrumentPlatformInstrument KeywordsPlatform Keywords

Potential Spirals

Content InformationAttribute TypeAttribute NamesAttribute DefinitionsAttribute Units

Discovery Understanding

ConnectionOnlineResource:NameDescriptionFunctionApplication Schema

Spiral None 0-33% 34-66% 67-99% All

Identification

Connection

Extent

Distribution

Description

Content

Lineage

AcquisitionInformation

Metadata Evaluation for Dataset XDate: 2010/10/24

Spirals and Rubrics

Progress

GOALS

Each record has a score that can be calculated using a consistent, standard tool

Initial Rubric for FGDC > ISO Translation

Identifying Bounding Extents

Web Accessible Folders - Populations of Records

Web Accessible Folder

15 17 17

14 14 16

14 15 15

14 16 16

Web Accessible Folder

18 17 17

17 17 17

17 17 17

18 17 17

Web Accessible Folder

26 26 24

25 25 26

24 22 27

26 24 22

Completeness Distributions

Machine Generated Records

Hand Hewn Records

Hierarchical Organization: Data

File

Platform Sensor

+has0..*

+ readme

+ parentDirectory 0..*

+ subdirectory0..*

Directory

Sensor

Hierarchical Organization: Documentation

MI_Metadata(from Metadata entity set information)

DS_DataSet

DS_Platform

+has1..*+ seriesMetadata

1..*

+ composedOf1..*

MultipleAggregation

+ superset 0..*

+ subset 0..*

DS_Sensor

DS_Series

DocumentationRepositoryISO 19115,

19115-2, 19119 and extensions

THREDDS

netCDF

DIF, FGDC,Data.Gov

SensorML

WCS, WMS, WFS, SOS

ISO

KML

Multiple Dialects and Connections