Geographic Information Systems and Geospatial Metadata CSCI 373: Advanced Database UNC Asheville April 27, 2006 Lynda Wayne US Federal Geographic Data

Geographic Information Systems and Geospatial Metadata

CSCI 373: Advanced Database • UNC Asheville • April 27, 2006

Lynda Wayne US Federal Geographic Data Committee / GeoMaxim

CSCI 373 GIS and Geospatial Metadata 20060424

What so special about spatial?

Geospatial Data Components:

entities and attributes




location




extent

or

‘geographic footprint’

most data IS geospatial….


How does GIS enable geospatial data?

Geographic Information Systems: capture

display

analyze

manage

geospatial data

esri.com


GIS Functions

Geospatial data capture and display:entities/attributes via a database

location via a coordinate/referencing system

extent via graphic objectsarcs

nodes/points

polygons

grids

esri.com


GIS Functions

Geospatial data analysislocation and extent enable entity/attribute:

Multi-level analysis:coincidence

deviation

proximity

temporal patterns

Graphic developed by Kenneth E. Foote and Margaret Lynch, Department of Geography, University of Texas


GIS Functions

Geospatial data analysislocation and extent enable entity/attribute:

Single-level (feature) analysiscontiguity

dispersion

spatial patterns


GIS Functions

Geospatial data analysis

location and extent enable entity/attribute:

Feature characterizationsize

shape

smoothness

salient points


GIS Functions

Geospatial data management access

share

assess

use

update

organize

geospatial data


What is geospatial metadata?

Data ‘reporting’ WHO created the data?

WHAT is the content of the data?

WHEN was it created?

WHERE is it geographically?

HOW was the data developed?

WHY was the data developed?



title

supplemental information

abstract

time period

author

sources

(file) size



entity

attributes


Metadata as a Data Component

MetadataTitleOriginatorPurposeAbstractGeographic ExtentTime Period of ContentSources UsedProcess DescriptionPositional AccuracyEntities and Attributes…….

phenomenaphenomena map / image / databasemap / image / database metadatametadata

abstraction abstraction

content context

DATA


DATA

map

(con

tent

)m

etadata

(context)

Metadata as a Data Component

access

share

use

• search• download

• describe• publish

• assess• apply

Data Management


Metadata the Awful

Geospatial Data Producers perceive metadata as:

time consumingexcessivefor the benefits of others

Geospatial Managers perceive metadata as:

non-productivecostly (time, training, software)

derive classify

collect

planimetric imagery

analysis

alternativecommittee

review

PLAN

charette

metadata?

metadata?

metadata?

metadata?

metadata?

metadata?


Metadata the Magnificent

Metadata can support:data management

project management

If it is:considered a component of the data

created during data development

populated with rich content

derive classify

collect

planimetric imagery

analysis

alternativecommittee

review

PLAN

charette

meta

meta

meta

meta


Data Management via Metadata

DataAccountability

Discovery

& Re-use

Maintenance

& Update

DataLiability


Data Management:Data Maintenance and Update

MaintenanceAre the data current?

• older than?• prior to significant change?

Are the data valid?• newer sources?• better methods?

UpdateContact informationDistribution policies, availability, pricingURLSNew derivations


Data Management:Data Discovery and Re-use

Marketing metadata in the past…

If you create metadata, other people can discover your data

If you create metadata, you can find your own data

New and improved message…


Data Management:Data Discovery and Re-use

Data discovery bythemes / attributes

geographic extent

temporal character

methods

sources

quality

Discoverable data is usable data


Data Management:Data Accountability

Exercise in data comprehension:

What do you know?

What don’t you know?

What should you know?

Are you willing to associate yourself with the metadata record?


Data Management:Data Accountability

Repeatable process:methodsvariablesparameters

Defensible process:public participationdecision-making

GIS-savvy public

Metadata can be crafted to preserve individual accountability in team projects


Data Management:Data Liability

Metadata is declaration of:Purpose

originator’s application of the data? ontological pedigree ?

Use Constraintsappropriate and inappropriate utility of the data

Completenesswhat is missing from the data

Distribution Liabilityexplicit liability of the producer and assumed liability of

the consumer

What to do…

What not to do…


Project Management via Metadata

PROJECTPLANNING

DELIVERABLES

COMMON LANGUAGE

PROJECT MONITORING


Project Management:Project Planning

Project design document:description / intentgeo & temporal extentsource dataattribute requirements

Benefits:expectations outlinedintegrated into processprovide medium to record progress


Project Management:Project Monitoring

Monitor:

status

QA/QC measures

changes

Requires that the metadata be actively maintained and reviewed.

time

mile

ston

es


Project Management:Common Language for Multi-participants

Common reference for:descriptors & parameterskeywords, vocabularies & thesauricontact informationattributesdistribution information

If reviewed regularly by all participants,improved opportunity for coordinating:

source dataanalytical methodsnew information

tem

plat

e


Project Management:Contract Deliverables

Metadata is a data component therefore part of any data deliverable

Clearly specify your metadata requirement via a metadata:

classification/validation schema, e.g. ‘level’ of metadata

template

specification manual

Provide a sample record if possible


Metadata Roles

If created with utility in mind, metadata can serve multiple roles:

and this is only human utility of metadata…

archivist preserve lineage

accountant preserve investment

developer document process

manager track progress

contributors communicate

consumer locate, assess, access data


How do I create geospatial metadata?

To create geospatial metadata you must:

1. make metadata part of the process

2. be familiar with the US metadata standard

3. utilize a metadata editor tool


Make Metadata Part of the Process

New tools enable us to better integrate metadata creation into the data development process


If metadata were collected throughout the data process…

1. more accurate (no guessing)

2. more details

3. better decision-making.



Build templatesidentify pertinent fieldspopulate fixed fields

standardized languagedistribution methodsstandards used

build source and contact libraries

templates can be built at multiple levels: organization, project, themes….



Iden

tific

atio

n In

form

atio

n

• title

• abs

tract

• pur

pose

• tim

e pe

riod

of c

onte

nt

• key

words

• com

plet

enes

s

Attrib

ute

Info

rmat

ion

• attr

ibut

e la

bels/

dom

ains

Data

Qua

lity

Attrib

ute

Info

rmat

ion

• com

pila

tion

accu

racie

s

• com

pila

tion

proc

esse

s

• sou

rce

files

• fie

ld c

heck

acc

urac

ies

• ana

lytica

l pro

cess

es• a

ttrib

ute

valu

es

Data Processing Data Planning Data Analysis

manager technicians analysts

Map metadata to the workflow



Establish policiesmandate use of standards and templates

develop boilerplate metadata deliverable language for data contractors

include metadata as a performance measure

require units to publish their metadata

publish metadata SOP to document policies and procedures



Content Standard for Digital Geospatial Metadata (CSDGM)imagery digital land surveys

GIS files geographic databases

required for use by:federal agenciesfederally-sponsored researchsome state/county/city governments

info at:http://www.fgdc.gov/metadata/

US Federal Metadata Standard


CSDGM Overview

Organized into seven primary sections:

1. Identification InformationGeneral bibliographic information including:

title, originator, data contact, status, date, time period of content, abstract, purpose, keywords, geographic location

2. Data Quality InformationLineage and data assessments

sources, process methods, accuracy, data processing contact


CSDGM Overview

3. Spatial Data OrganizationData format:

vector, point, raster

4. Spatial Reference InformationCoordinate system parameters:

horizontal / vertical coordinate system, projection, datum


5. Entity and Attribute InformationDatabase design

entities, attributes, domains, description of data values

6. Distribution InformationHow to acquire the data

distribution contact, available formats, online distribution website, costs

CSDGM Overview


CSDGM Overview

7. Metadata Reference InformationGeneral information about the metadata record itself

metadata contact, metadata standard used, metadata creation date, metadata review date


CSDGM Overview

But that wasn’t enough for some people...

Extensions:added elements to the CSDGM

• Remote Sensing Extension

Profilescontent requirements for specific elements

may included added elements as well• Biological Profile

• Shoreline Profile


Transition to ISO Metadata

Standardized Metadata

Content Standard for Digital Geospatial Metadata (CSDGM) Vers. 2.0

remains current US standard

International Geospatial Metadata Standard (ISO 19115)

standard completed

US (ANSI) adoption in progress


1. Content

CSDGM similar and new elements

Domains and conditionality

Essential or core metadata

2. Format

UML / XML

Multi-level metadata

What’s new with ISO metadata?


Metadata Tools

How do I determine the best metadata tool?Does your organization provide a tool?Does your GIS software provide an internal editor?Do you use a CSDGM Profile or Extension? Do you need to document data resource beyond those managed within your GIS? Do you need a tool that is easily distributed to partners? What features are most important to you?

auto-capture of information bundling of metadata with data creation and use of templates easy to use interface robust help systems and tutorials


Metadata Tools

What metadata editors are available?Freeware

tkme/xtmeUSGS, supports all profiles/extensions, well-maintained

MetaVistUSFS, desktop, supports biological profile

MERMAidNOAA CSC, online utility supports biological and shoreline profiles


Metadata Tools

What metadata editors are available?Commercial

SMMS (Intergraph GeoMedia and stand-alone)

auto capture from multiple file types, contact/source libraries, data exploration utilities

ArcCatalogmetadata ‘synchronized’ w/data, ability to enclose

documents, metadata bundled with data export

Blue Angelhighly customizable, supports non-geospatial metadata


Metadata Tools

What other metadata tools are available?Parsing and Validation

Metadata Parser (mp)checks for conformance to CSDGM specified:

• conditionality (are all mandatory elements are populated?) • data formats • element domains

mp batchbatch processor shareware from Intergraph

Chew N Spit (cns)• Rectifies indentation• Inserts capitalization and underbars

FGDC ‘compliant’ metadata must pass mp!


Metadata Tools

What other metadata tools are available?Conversion

error2htmprovides user-friendly interpretation of mp error report

dbfmetaconverts dbase to CSDGM Entity Attribute elements

mq provides interface for editing large, diverse collections of

metadata


How is metadata used to distribute geospatial data?

Geospatial data portals, online systems and catalogs:Geospatial One-Stop US Federal geospatial data portal

NC OneMapState geospatial data portal

Buncombe County GISCounty GIS

National Biological Information InfrastructureThematic Metadata Catalog


Geospatial OneStop http://www.geodata.gov


NC OneMap http://www.NCOneMap.org


Buncombe County GIS http://www.buncombecounty.org/governing/depts/GIS


NBII Metadata Catalog http://mercury.ornl.gov/nbii/


Future Role of Metadata

External Utility

distribution role will be limited to exact vs. general queries with improvements to context-based search utilities (MetaCarta)

Internal Utility

management role will increase with shift to OOP-based GIS (hierarchy, relations, etc.)

Geospatial Metadata is a GIS Best Practice


Questions?

Lynda [email protected]

FGDC Metadata Website www.fgdc.gov/metadata

ESRI GIS Primer http://www.gis.com/whatisgis/

Documents

Geographic Information Systems and Geospatial Metadata CSCI 373: Advanced Database UNC Asheville April 27, 2006 Lynda Wayne US Federal Geographic Data