139
ArcView Metadata ArcView Metadata Training: Training: American Samoa American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Embed Size (px)

Citation preview

Page 1: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

ArcView Metadata Training:ArcView Metadata Training:American SamoaAmerican Samoa

James ByrneJosh Murphy

NOAA Coastal Services CenterJuly 29-30, 2003

Page 2: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Course Outline

Part I: What Is Metadata?

Part II: Metadata Creation

Part III: Class Exercise

Part IV: Clearinghouses

Page 3: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

First…. Some Terms

Metadata - Documentation of geospatial data written in a consistent manner

FGDC - Federal Geographic Data Committee

CSDGM - Content Standard for Digital Geospatial Metadata, referred to commonly as “The Standard” or “The Content Standard”

Clearinghouse - A distributed catalog of metadata

Geospatial - refers to a geographic location

Page 4: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Part I: What Is Metadata?Part I: What Is Metadata?

Page 5: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Simply put, metadata is information

about your data.

What is Metadata?

Page 6: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

This is the metadata for this.

What’s Missing?

Aunu`u

Page 7: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Author(s) Boullosa, Carmen. Title(s) History of American Samoa / by Carmen Boullosa Place New York : Grove Press, 1997. Physical Descr viii, 180 p ; 22 cm. Subject(s) Oceana Format Reference

Author(s) Boullosa, Carmen. Title(s) History of American Samoa / by Carmen Boullosa Place New York : Grove Press, 1997. Physical Descr viii, 180 p ; 22 cm. Subject(s) Oceana Format Reference

This is the metadata for this.

While the card-catalog entry is a form of metadata, it does not address topics such as

quality, accuracy, or scale. Well-written geospatial metadata describes these and many more aspects of the data.

Page 8: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Identification_Information: Citation: Citation_Information: Originator: United States Department of Commerce, National Oceanic and Atmospheric Administration (NOAA), National Ocean Service (NOS), Coastal Services Center (CSC) Publication_Date: 20020923 Title: Vectorized Shoreline of Hawaii, Derived from Landsat ETM, 2002 Edition: first Geospatial_Data_Presentation_Form: vector digital data Publication_Information: Publication_Place: Charleston, SC Publisher: United States Department of Commerce,

Identification_Information: Citation: Citation_Information: Originator: United States Department of Commerce, National Oceanic and Atmospheric Administration (NOAA), National Ocean Service (NOS), Coastal Services Center (CSC) Publication_Date: 20020923 Title: Vectorized Shoreline of Hawaii, Derived from Landsat ETM, 2002 Edition: first Geospatial_Data_Presentation_Form: vector digital data Publication_Information: Publication_Place: Charleston, SC Publisher: United States Department of Commerce,

This is the metadata for this.

What is Metadata?

Page 9: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata contains vital information.Metadata contains vital information.Imagine, if you will…

You are given two identical cans without labels. One contains cat food, the other contains tuna (dolphin-safe, of course).

You must choose one these cans,

and then eat the contents.

Page 10: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Other Examples?

What is Metadata?

Page 11: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Properly documented

data provides vital information

to interested parties.

Page 12: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata is that component of data which describes it.

Environmental Sensitivity Index Data

Metadata

RARNUM - unique combination of species, concentration, and seasonality

CONC (concentration) = Density species is found at location

Season_ID = seasonality code link to the seasonal table

Element - Biology group

What is Metadata?

Page 13: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

It’s data about a data set.It’s data about a data set.

Title

Scale

Source

Content

Location

Publication

Access

Title

Scale

Source

Content

Location

Publication

Access

MetadataMetadataMetadataMetadata

GIS files

Imagery

Geospatial databases

GPS data

GIS files

Imagery

Geospatial databases

GPS data

Data setData setData setData set

What is Metadata?

Page 14: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata describes…

CONTENT

CONDITION

QUALITY

Characteristics of the data

Characteristics of the data

What is Metadata?

Page 15: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata

Non-spatial orattributes

Spatial

Because metadata provides vital information about a dataset, it should never be viewed or

treated as a separate entity.

Take Home Message

Metadata is a critical and

integral component of any complete

data set.

Metadata is a critical and

integral component of any complete

data set.

Page 16: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Two similar Two similar paintings by paintings by

Picasso up for Picasso up for auction sold for auction sold for vastly different vastly different

prices. prices.

Why?

One had metadata...

...One didn’t.

The Value of Metadata

Page 17: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata should be updated to reflect changes in the data.

19701970

HEWHEWWestern SamoaWestern SamoaBritish HondurasBritish Honduras

Trust TerritoryTrust TerritoryCape Hatteras Light Cape Hatteras Light

ArpanetArpanetMt. St. HelenMt. St. Helen

West GermanyWest Germany

20002000

HHS & HUDHHS & HUDSamoaSamoaBelizeBelizeU.S. CommonwealthU.S. CommonwealthCape Hatteras LightCape Hatteras LightInternetInternetMt. St. HelenMt. St. HelenGermanyGermany

Page 18: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata has Metadata has other value other value

associated with associated with it.it.

Page 19: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• Avoid duplication Avoid duplication

• Share reliable informationShare reliable information

• Publicize effortsPublicize efforts

• Reduce workloadReduce workload

For data developers, metadata...

The Value of Metadata

Page 20: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• Facilitates understandingFacilitates understanding

• Focuses on key elements Focuses on key elements

• Enables discovery — inside and outside Enables discovery — inside and outside of organizationsof organizations

For data users, metadata...

The Value of Metadata

Page 21: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

For organizations, metadata...

The Value of Metadata

• Protect investment in data

• Create an institutional memory

• Counter personnel changes

• Allow sharing of data with other agencies

• Reduce costs

• Limit potential liability

• Save time and money

Page 22: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata as a “data discovery” toolMetadata as a “data discovery” tool

This saves time and money.

If it’s geospatial data you need, metadata helps

• Find data of interest

• Determine the usefulness of the data

• Determine how to access the data

The Value of Metadata

Page 23: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata Standards

Think for a moment how hard it would be to…

… bake a cake without standard units of measurement.

… put gas into your car without standard nozzle sizes.

… plug a lamp into a socket without standard electrical outlets.

Page 24: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The standard for

metadata ensures a level

of consistency in

data documentation.

Standards ensure consistency.

Metadata Standards

Page 25: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The Federal Geographic Data Committee (FGDC) was organized in 1990 under the

Office of Management and Budget to promote the coordinated use, sharing,

and dissemination of geospatial data on a national basis. The FGDC was tasked

with creating a metadata standard to meet these objectives.

The Metadata Standard

Metadata Standards

Page 26: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

"... each agency shall document all new

geospatial data it collects or produces, either

directly or indirectly, using the standard under

development by the FGDC, and make that

standardized documentation electronically

accessible to the Clearinghouse network."

The Content Standard for Digital Geospatial Metadata (CSDGM)

Executive Order 12906, 1994

Metadata Standards

Page 27: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The Content Standard utilizes...The Content Standard utilizes...

• Common termsCommon terms

• Common definitionsCommon definitions

• Common languageCommon language

• Common structureCommon structure Access

constraints

Citation

currentness

entity

attrib

ute

domain

lineage

Process step

Metadata Standards

Page 28: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The Content Standard helps The Content Standard helps

the user determine...the user determine...

• If a set of geospatial data is available and fit for a particular use.

•How to access and transfer the data set.

Metadata Standards

Page 29: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

FGDC’s Metadata

Workbook

Defines the 334

metadata elements.

Metadata Standards

Page 30: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

What do I use “The Workbook” for?

• It is the definitive resource for applying the FGDC Content Standard.

• However, it does not define the production rules.

• It describes element domain values, which are valid values that can be assigned to the data element.

• It provides section and element definitions.

Page 31: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Interpreting the Metadata Workbook

A data element is a logically primitive itemof data. Data elements are the things thatyou “fill in.”

The form for the definition of a data element is:

Data element name -- definition.Type: (choice of “integer”, “real”, “text”, “date”, or “time”)Domain: (describes valid values that can be assigned)

An example of the definition of a data element is:

Abstract -- a brief narrative summary of the data set.Type: textDomain: free text

Note: Data element definitions are containedin the text of the Content Standard,

not in the graphical production rules.

Page 32: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• It is a quick reference for production rules and structure.

Use the “Graphical Representation”for quick access.

• You will still need to use the workbook to find the definition of a particular element and its domain.

Organization of the Content Standard

Page 33: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

DataQuality

Information

SpatialData

OrganizationInformation

SpatialReference

Information

Entityand

AttributeInformation

4 52 6 731

Metadata

The Three Supporting SectionsThe Three Supporting Sections

9 Time PeriodInformation

10 Contact

Information

8 Citation

Information

DistributionInformation

MetadataReference

Information

IdentificationInformation

Organization of the Content Standard

The Seven Main Sections The Seven Main Sections

Page 34: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Mandatory - must be provided.

MeaningData

ElementCompound

Element

What’s Mandatory? What’s Not?

Mandatory if Applicable - must be provided if the data set exhibits

the defined characteristic.

Optional - provided at the discretion of the data set producer.

Page 35: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 36: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Remember, metadata is a legacy document that

concisely sums up your data or data set.

Without metadata, your data set is

incomplete.

Page 37: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

FOR MORE INFORMATION

Michael Moeller NOAA CSC Metadata Specialist

[email protected]/metadata/

Page 38: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Part II: Metadata CreationPart II: Metadata Creation

Page 39: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Writing Metadata

is not THAT bad!

• First records are the hardest.• Not all fields may need to be filled in.• Tools are available.• Training classes can be taken.• Can often be produced automatically.• Can (and should) be reviewed

for updates.

Page 40: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Templates can help!!

• Contain information that is specific to your project or organization

• Allow you to enter and save pertinent information for use at later date

• Save time and effort!• No special tools needed!• Like any other metadata, can (and

should) be reviewed for updates.

Writing Metadata

Page 41: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Before you begin writing,get organized.

Writing Metadata

Page 42: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Document your data as you go.

Writing Metadata

Page 43: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Write so others can understand.

Writing Metadata

Page 44: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• Define all acronyms.

• Avoid using jargon.

• Clearly state data limitations.

Writing Metadata

Keep your readers in mind.

Page 45: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Always review your document.

Writing Metadata

Page 46: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Items required

Chocolate

FGDCWorkbook

Metadata entry tool

Page 47: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Tool Time

A sample of some of the available tools for metadata creation, validation, and publication.

• CNS and MP“Chew ‘n spit,” checks and corrects structural errors, and “Metadata Parser”, which checks for errors in element compliance.

• NOAA CSC MetaScribe Allows you to create a template record that can be used to create large numbers of similar records.

• NOAA CSC ArcView Metadata Collector Extension for ArcView 3.x.

• TKMEText editor used for metadata entry.

• ArcCatalog Metadata Editor Metadata creation in ArcGIS

Page 48: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

TKME

• An editor for formal metadata.• TKME is intended to simplify the process of creating metadata that conform to the content standard

Page 49: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata Collector for ArcView 3.2

• A free, downloadable extension for ArcView 3.x users• Enters information for certain elements automatically• Allows user to save individual elements for future use

Page 50: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

At the right side of most of the screens will be the option to Retrieve and Save the information you have entered into the fields. This allows you to save frequently used information such as contact and similar abstracts to be used repeatedly. These are generally saved as either .dbf or .txt files in the working directory specified.

On each screen, there is a SectionHelp and a Section Example button.The Section Help button opens a window containing definitions of the metadataelements for that section. The SectionExample button provides an example of an FGDC-compliant metadata record.

Metadata Collector for ArcView 3.2

Page 51: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Certain sections are read directly from the data set by the ArcView Metadata Collector

Metadata Collector for ArcView 3.2

Page 52: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

When you have finished all of the metadata sections, you will be presented with the option to save the metadata file as both a text and an HTML file.

Metadata Collector for ArcView 3.2

Page 53: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

MetaScribeMetaScribe

• A tool for the creation of multiple, similar metadata records• Template driven

Page 54: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Metadata Parser (mp)Metadata Parser (mp)

• DOS-based tool that compiles and checks the syntax of “raw” metadata

• Input must be either text, XML, or SGML• Creates outputs in multiple formats (HTML, TXT, XML, SGML)• Also creates an error file

Page 55: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

ArcCatalog Metadata EditorArcCatalog Metadata Editor

• Included with basic ArcGIS 8.x software• Simple to use:

• Projection parameters automatically captured (if .prj file present)

• Can use template to automatically fill in contact, distribution information

Page 56: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Using the AV Metadata Collector ExtensionUsing the AV Metadata Collector Extension

• For the remainder of this section, the instructor will demonstrate For the remainder of this section, the instructor will demonstrate metadata creation using the FGDC Content Standard and the metadata creation using the FGDC Content Standard and the ArcView Metadata Collector extension. ArcView Metadata Collector extension.

Page 57: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 1 – Identification InformationSection 2 – Data Quality InformationSection 3 – Spatial Data Organization InformationSection 4 – Spatial Reference InformationSection 5 – Entity and Attribute InformationSection 6 – Data Distribution InformationSection 7 – Metadata Reference Information

Review: The Seven Main Sections of the Content Standard

Using the AV Metadata Collector ExtensionUsing the AV Metadata Collector Extension

Page 58: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Data Set Example

Tutuila Shoreline

Page 59: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 1 – Identification Information

Basic Information about the data set.

Page 60: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 1 – Identification Information

Metadata

Page 61: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The title is critical in helping others find your data.

Which is better?

Greater Yellowstone Rivers from 1:126,700 Forest Visitor Maps (1961-1983)

Section 1

Page 62: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• The title is the first thing a user sees when searching for data• The title helps a user quickly determine the usefulness of data

Include topic, time and place!

Bad title (user has to read description):“Roads”

Better title:“Roads Shapefile for Guam - 2000”

Title, title, title

Section 1

Page 63: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Bounding Coordinates

West_Bounding_Coordinate: 145.69

East_Bounding_Coordinate: 145.83

North_Bounding_Coordinate: 15.29

South_Bounding_Coordinate: 15.09

15.29, 145.69

15.09, 145.83

Page 64: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Select your key words wisely.

• Use unambiguous words.

• Use descriptive words.

• Fully qualify geographic locations.

Key Words

Page 65: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Theme:Theme_keyword_thesaurus: NoneTheme_keyword: major roadsTheme_keyword: highwaysTheme_keyword: transportation networkTheme_keyword: thoroughfaresTheme_keyword: vector digital dataTheme_keyword: geographic information system

Key Words

Page 66: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Access and Use Constraints

• Essentially liability statements

• Example:

Section 1

Use_Constraints: Data set is not for use in litigation. While efforts have been made to ensure that these data are accurate and reliable within the state of the art, NOAA, cannot assume liability for any damages, or misrepresentations, caused by any inaccuracies in the data, or as a result of the data to be used on a particular system. NOAA makes no warranty, expressed or implied, nor does the fact of distributionconstitute such a warranty.

Use_Constraints: Data set is not for use in litigation. While efforts have been made to ensure that these data are accurate and reliable within the state of the art, NOAA, cannot assume liability for any damages, or misrepresentations, caused by any inaccuracies in the data, or as a result of the data to be used on a particular system. NOAA makes no warranty, expressed or implied, nor does the fact of distributionconstitute such a warranty.

Page 67: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Link to on-line data

Other_Citation_Details:Online_Linkage: http://www.csc.noaa.gov/hurricane_tracks.shp

Page 68: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 1 – Identification Information

Metadata

Page 69: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 2 – Data Quality Information

A general assessment of the quality of the data set.

Page 70: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 2 – Data Quality Information

A general assessment of the quality of the data set.

Page 71: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

How thoroughly and correctly the features in the data set are described.

• What features have been omitted ? • What non-existent features are represented ? • How correct is their classification ? How can you test and report Attribute Accuracy?

• Field Verification• Visual comparison of source data to hard copy

Attribute Accuracy

Page 72: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Attributes

How accurate are these attributes?

Attribute Accuracy

Page 73: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

DATA_QUALITY_INFORMATION

Attribute_Accuracy Attribute_Accuracy_Report: A team of field investigators participated in data verification exercises June, 1996 and December, 1996. Data validation teams consisted of personnel from Oak Ridge National Laboratory, Moss Landing Marine Laboratories, Ray L. Harris, Jr., and the Coastal Services Center. The team was equipped with a portable color laptop computer linked to a Global Positioning System (GPS). The field station runs software that supports the classified data as a raster background with the road network as a vector overlay with a simultaneous display of live GPS coordinates. Accuracy assessment points were generated with Erdas Imagine software using a stratified random sample. To make the acquisition of the field reference data more practical, a sixteen pixel buffer area around roads (i.e. 8 pixels on each side of the road) including logging trails was created. Seven thousand random points were generated within this area for the accuracy assessment. See the accuracy assessment table for results of data verification exercise.

Attribute Accuracy

Exa

mp

le A

ttri

bu

te A

ccu

racy

Rep

ort

Page 74: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

A closer lookDo these footprints accurately represent these?

Attribute_Accuracy: Attribute_Accuracy_Report: Attribute accuracy was tested by manual comparison of the source with hardcopy printouts of the digital building footprint data. The attributes were visually compared to attributes in the source data (digital orthophoto).

Attribute Accuracy

Page 75: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Addresses geometric problems in your dataset-overshoots-undershoots-broken polygons-missing or duplicate labels

A typical Logical Consistency Statement:

Logical_Consistency_Report: These data are believed to be logically consistent, though no tests were performed. There are no overshoots, undershoots or broken polygons. Line geometry is topologically clean.

Logical Consistency

Page 76: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Geometric/Logical Consistency Problems

Page 77: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

How the coordinate descriptions of features compare to the actual locations of those features on the ground.

How far away is a map feature from its actual location in the world?

How can you test for and report Positional Accuracy?

Comparison of your data to more accurate data (survey data) GPS accuracy Using the National Map Accuracy Standards (positional accuracy for paper maps only)

Positional Accuracy

Page 78: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Q: How horizontally accurate is the position of this shoreline?

A: As accurate as the data itwas derived from.

Positional Accuracy

Page 79: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Positional_Accuracy: Horizontal_Positional_Accuracy: Horizontal_Positional_Accuracy_Report: The data were created by delineating the boundary off a USGS 7.5 minute Topographic Map at 1:24000 scale. Therefore, the horizontal accuracy is assumed to be within National Map Accuracy Standards, with a horizontal accuracy of 45.6 feet at the 95% confidence level.

Positional_Accuracy: Horizontal_Positional_Accuracy: Horizontal_Positional_Accuracy_Report: The data were collected with a trimble pathfinder Global Positioning System. The horizontal accuracy of the point data is 300ft.

Positional Accuracy

Examples

Using National Map Accuracy Standards

Using GPS accuracy

Page 80: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Be specific. Quantify when you can.

Vague: We checked our work and it looks complete.

Specific: We checked our work using 3 separate sets of check plots reviewed by 2 different people. We determined our work to be 95% complete based on these visual inspections.

Process Step

Page 81: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 2 – Data Quality Information

Metadata

Page 82: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 3 – Spatial Data Organization Information

The mechanism used to represent spatial Information in the data set.

Page 83: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 84: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Spatial Data Organization Information

What is the Structure of the Data?

Raster

Vector

Row and Column count

Vector Object Count

Page 85: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 3 – Spatial Data Organization Information

Metadata

Page 86: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 4 – Spatial Reference Information

The description of the reference frame for, andThe means to encode coordinated in the data set.

Page 87: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 88: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 4 - Spatial Reference Information

Three Choices under Horizontal Coordinate System

• Geographic Latitude and Longitude

• Planar Map Projection Grid Coordinate System Local Planar

• Local

Page 89: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Geographic Coordinate System

Latitiude and longitude measurements define a position on the Earth.

Units of measurement can be• decimal degrees• decimal minutes• decimal seconds• degrees and decimal minutes• degrees minutes and seconds• radians • grads

Page 90: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Planar Systems

Map Projection - representation of the earth’s surface

East-West Projections: Lambert, Albers (Conic)Used in Florida, Massachusetts, and Ohio

North-South Projections: Transverse Mercator (Cylindrical) Used in Florida and California

Grid Coordinate Systems - State Plane and UTM

Used by states as common coordinate systemsBased on map projections

Page 91: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Datums

A datum is a set of parameters defining a coordinate system.

Typically, your data’s projection will be referenced to either North American Datum NAD 83World Geodetic System 1984North American Datum NAD 27

Page 92: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 4 – Spatial Reference Information

Metadata

Page 93: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 5 – Entity and Attribute Information

Information about the content of the data set,including the entity types, their attributes, andthe attribute values that may be assigned.

Page 94: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 95: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Attribute Table

Page 96: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

attributes

attribute values

Attribute Table

Page 97: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Detailed Attribute DescriptionNot only do you have to describe your attributes but you also have to describe the values

Attribute Domains: domains are used to describe attribute values

1) Range Domain: a sequence of values- if the attribute is “water_depth” and the values are between 0 and 150, a range domain is suitable.

2) Enumerated Domain: comprised of a list of values- if the attribute is “landcover_code” and the list of values is between 1 16, then an enumerated domain should be used.

3) Codeset Domain: data values are defined by a set of codes- if the attribute is “wetland_id#” and the codes are defined in a standard or code book, then the codeset domain should be used.

4) Unrepresentable Domain: the set of data values cannot be represented- numbers assigned by software program that are meaningless

Page 98: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Enumerated Domain

To understand thislegend, each value in this enumerateddomain will have to be defined.

Page 99: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 5 – Entity and Attribute Information

Metadata

Page 100: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 6 – Distribution Information

Information about the distributor of and optionsfor obtaining the data set.

Page 101: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 102: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 6 – Distribution Information

Metadata

Page 103: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 7 – Metadata Reference Information

Information on the currentness of the metadata information, and the responsible party.

Page 104: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 105: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Section 7 – Metadata Reference Information

Metadata

Page 106: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• Have someone else read it.

• If you’re the only reviewer, put it away and read it again later.

• Check for clarity and omissions.

Review your final product.

Reviewing Metadata

Page 107: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• Can a novice understand what you wrote?

• Are your data properly documented for posterity?

When you review your work, ask:

Reviewing Metadata

Page 108: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• Does the documentation present all the information needed to use or reuse the data?

• Are any pieces missing?

When you review your work, ask:

Reviewing Metadata

Page 109: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Part III: Class ExercisePart III: Class Exercise

Page 110: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 111: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003
Page 112: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Part IV: ClearinghousesPart IV: Clearinghouses

Page 113: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

ClearinghousesClearinghouses

A metadata clearinghouse is a A metadata clearinghouse is a

location — typically accessed location — typically accessed

through the Internet — to through the Internet — to

search for spatial data setssearch for spatial data sets

Page 114: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

A clearinghouse is a decentralized system of Internet servers you can search

Servers with metadataServers with metadata

Client

ClearinghousesClearinghouses

Page 115: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Clearinghouses make Clearinghouses make

metadata records easy to metadata records easy to

find find

ClearinghousesClearinghouses

Page 116: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The National Geospatial Data The National Geospatial Data

Clearinghouse has more than 100 spatial Clearinghouse has more than 100 spatial

data servers with digital geographic datadata servers with digital geographic data

ClearinghousesClearinghouses

Page 117: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The NGDC The NGDC is a set of information services is a set of information services

that use that use hardware, software,hardware, software, and and

telecommunications networkstelecommunications networks to provide to provide

searchable access to informationsearchable access to information

ClearinghousesClearinghouses

Page 118: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• FGDC Geospatial Data Clearinghouse

• Montana State Library Natural Resource Information System GIS

• Nebraska Geospatial Data Clearinghouse

• Wisconsin Land Information Clearinghouse

Some specific examples:Some specific examples:

ClearinghousesClearinghouses

Page 119: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

You can search all or part of You can search all or part of

the community in a single the community in a single

sessionsession

x

ClearinghousesClearinghouses

Page 120: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

ClearinghousesClearinghouses

www.fgdc.gov

Page 121: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

You can define your criteria

ClearinghousesClearinghouses

Page 122: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

You can select a server

ClearinghousesClearinghouses

Page 123: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

You can view your search results

ClearinghousesClearinghouses

Page 124: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

The FGDC Clearinghouse selected

the search and retrieve software

ANSI Z39.50-1995 (ISO 10163-1995)

Clearinghouse ImplementationClearinghouse Implementation

Page 125: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

How can you participate? How can you participate?

• Set up your own node

• Send metadata to an existing node

• Have another organization host your node

• Put metadata on a web page for future “harvesting” to a node

Clearinghouse ImplementationClearinghouse Implementation

Page 126: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Why set up a node? Why set up a node?

• YouYou control your metadata

• It’s easy to set up

• You choose the software

• The software operates on typical web server platforms

Clearinghouse ImplementationClearinghouse Implementation

Page 127: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

• In setting up a node, most work is in preparing metadata for available data sets

• Store these data in a structured form, according to the standard

Clearinghouse ImplementationClearinghouse Implementation

Page 128: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Before you can index your

metadata into a clearinghouse,

you must check for completeness,

accuracy, and quality

Clearinghouse ImplementationClearinghouse Implementation

Page 129: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Your metadata must meet clearinghouse requirements:

• Proper format

• Proper field names and values

• Appropriate formats: text, HTML, and fgfSGML

Clearinghouse ImplementationClearinghouse Implementation

Page 130: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Parsing and validation tools check for Parsing and validation tools check for structural or content errorsstructural or content errors

errorerrorreportsreports

metadatametadatadocumentsdocuments

metadata parser metadata parser softwaresoftware

mpmp

Clearinghouse ImplementationClearinghouse Implementation

Page 131: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Run cns output through mp to make text, SGML, HTML files

Run cns output through mp to make text, SGML, HTML files

YESYESCorrect original fileCorrect original file

Run original file through cnsRun original file through cns

Errors in error.txt?YESYES

CreateMetadataCreate

Metadata

Run cns output through mpRun cns output through mp

NONO

Correct original fileCorrect original file

Place 3 files on searchable system

Place 3 files on searchable system

Errors in error.txt?

Errors in error.txt?

NONO

Clearinghouse ImplementationClearinghouse Implementation

Page 132: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

mp produces metadata in HTML, mp produces metadata in HTML, SGML, and TEXTSGML, and TEXT

mpmpmpmp TEXTTEXTTEXTTEXTHTMLHTMLHTMLHTML

SGMLSGMLSGMLSGML

Clearinghouse ImplementationClearinghouse Implementation

Page 133: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

<html>

<head>

<title>1989 Land Cover/Land Use on the Upper Mississippi River System</title>

</head>

<body>

<h1>1989 Land Cover/Land Use on the Upper Mississippi River System</h1>

<h2>Metadata:</h2>

<ul>

<li><A HREF="#Identification_Information">Identification_Information</A>

<li><A HREF="#Data_Quality_Information">Data_Quality_Information</A>

<li><A HREF="#Spatial_Data_Organization_Information">Spatial_Data_Organization_Information</A>

<html>

<head>

<title>1989 Land Cover/Land Use on the Upper Mississippi River System</title>

</head>

<body>

<h1>1989 Land Cover/Land Use on the Upper Mississippi River System</h1>

<h2>Metadata:</h2>

<ul>

<li><A HREF="#Identification_Information">Identification_Information</A>

<li><A HREF="#Data_Quality_Information">Data_Quality_Information</A>

<li><A HREF="#Spatial_Data_Organization_Information">Spatial_Data_Organization_Information</A>

mp HTML filemp HTML file mp HTML filemp HTML file

Clearinghouse ImplementationClearinghouse Implementation

Page 134: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

mp HTML filemp HTML file mp HTML filemp HTML file

Clearinghouse ImplementationClearinghouse Implementation

Page 135: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

<!DOCTYPE METADATA PUBLIC "-//FGDC//DTD METADATA 1.0//EN"><metadata>

<idinfo>

<citation>

<citeinfo>

<origin>Kurt P. Kowalski and Douglas A. Wilcox</origin>

<origin>Great Lakes Science Center</origin>

<origin>Biological Resources Division</origin>

<pubdate>1997</pubdate>

<title>Coastal Wetland Vegetation Analysis (Metzger Marsh)

</title>

<pubinfo>

<pubplace>Ann Arbor, MI</pubplace>

<!DOCTYPE METADATA PUBLIC "-//FGDC//DTD METADATA 1.0//EN"><metadata>

<idinfo>

<citation>

<citeinfo>

<origin>Kurt P. Kowalski and Douglas A. Wilcox</origin>

<origin>Great Lakes Science Center</origin>

<origin>Biological Resources Division</origin>

<pubdate>1997</pubdate>

<title>Coastal Wetland Vegetation Analysis (Metzger Marsh)

</title>

<pubinfo>

<pubplace>Ann Arbor, MI</pubplace> mp SGML filemp SGML file mp SGML filemp SGML file

Clearinghouse ImplementationClearinghouse Implementation

Page 136: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Identification_Information:

Citation:

Citation_Information:

Originator: Environmental Management Technical Center

Publication_Date: 19950829

Title: 1989 Land Cover/Land Use on the Upper Mississippi River System

Geospatial_Data_Presentation_Form: Map

Publication_Information:

Publication_Place: Environmental Management Technical Center

Publisher: Environmental Management Technical Center (EMTC)

Other_Citation_Details: White, B. M. and T. W. Owens. 1991. Geographic Information System Pilot Project For The Upper Mississippi River System. U.S. Fish and Wildlife Service, National Ecology Research Center, Fort Collins, Colorado, June 1991. LTRMP 91-05. 48 pp. + Appendix.

Identification_Information:

Citation:

Citation_Information:

Originator: Environmental Management Technical Center

Publication_Date: 19950829

Title: 1989 Land Cover/Land Use on the Upper Mississippi River System

Geospatial_Data_Presentation_Form: Map

Publication_Information:

Publication_Place: Environmental Management Technical Center

Publisher: Environmental Management Technical Center (EMTC)

Other_Citation_Details: White, B. M. and T. W. Owens. 1991. Geographic Information System Pilot Project For The Upper Mississippi River System. U.S. Fish and Wildlife Service, National Ecology Research Center, Fort Collins, Colorado, June 1991. LTRMP 91-05. 48 pp. + Appendix.

mp TEXT filemp TEXT file mp TEXT filemp TEXT file

Clearinghouse ImplementationClearinghouse Implementation

Page 137: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Clearinghouse ImplementationClearinghouse Implementation

Page 138: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

For more information on For more information on clearinghouse implementation:clearinghouse implementation:

Clearinghouse ImplementationClearinghouse Implementation

www.fgdc.gov/clearinghouse/tutorials/howto.html

OR

Please contactJohn Ulmer

NOAA CSC Computer [email protected]

Page 139: ArcView Metadata Training: American Samoa James Byrne Josh Murphy NOAA Coastal Services Center July 29-30, 2003

Any Questions?Any Questions?

Clearinghouse ImplementationClearinghouse Implementation