International Polar YearData Management

CODATA06Beijing, China25 October 2006

Mark A. ParsonsIPY Data Policy and Management Sub-committeeIPY Data and Information Service

QuickTime™ and aTIFF (Uncompressed) decompressor

are needed to see this picture.

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20062 QuickTime™ and aGraphics decompressor

are needed to see this picture.

NOAA

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20063 QuickTime™ and aGraphics decompressor

are needed to see this picture.

IPY 11882-83

IPY 21932-33

IGY1957-58

IPY 2007-08

IPY Timeline

the 125 Year

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20064 QuickTime™ and aGraphics decompressor

are needed to see this picture.

IPY Themes

• Current status• Past & future changes• Linkages to global processes• Investigate frontiers of science in polar

regions• Vantage point to earth history & to

space• Social & cultural dynamics & resiliency

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20065 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Joint CommitteeIPY

Joint CommitteeIPY

Data Policy & Management

Subcommittee

Data Policy & Management

Subcommittee

ObservationsSubcommitteeObservations

SubcommitteeEducation, Outreach &

Communication Subcommittee

Education, Outreach & Communication Subcommittee

ProgrammeOffice

ProgrammeOffice

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20066 QuickTime™ and aGraphics decompressor

are needed to see this picture.

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20067 QuickTime™ and aGraphics decompressor

are needed to see this picture.

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 20068 QuickTime™ and aGraphics decompressor

are needed to see this picture.

USFWS

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200610 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Systems and Innovation

31%40%

28%23%

15% 18%

53% 33%46%

49%

51%54%

16%27% 26% 28%

34%28%

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

1994 1996 1998 2000 2002 2004

The Standish Group’s “CHAOS report”. An assessment of over 40,000 IT application projects

Succeeded

“Challenged”

Failed

“We're entering a new world in which data may be more important than software.”

- Tim O'Reilly

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200611 QuickTime™ and aGraphics decompressor

are needed to see this picture.

The People Part

Service counts.

“A striking proportion of project difficulties stem from people in both customer and supplier organisations failing to implement known best practice.”

— Oxford University/Computer Weekly survey of public and private sector IT projects (emphasis added)

However, people (data managers and data providers) are much more able to adapt to change, uncertainty, and messy systems

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200612 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Exchange for Local Observations and Knowledge in the Arctic

• Local and traditional knowledge (LTK) encompasses the various systems of knowledge, practice, and belief gained through experience and culturally transmitted among members and generations of a community.

• ELOKA is concerned with:• Fair and multilevel access• Fair and multilevel use• Broad sharing of LTK while maintaining local control• Legal requirements

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200613 QuickTime™ and aGraphics decompressor

are needed to see this picture.

What’s been done

• Data Committee has defined a data policy

• Data Committee working on a data strategy and outlining overall IPY data flow.

• Workshop on data management (see report at http://nsidc.org/ipydis)

• Proposals submitted (some funded) to manage and ensure fair access to IPY data.

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200614 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Data used by IPY

Data generated by IPY

Special Cases:• Human subjects• Intellectual property of LTK• Where data release may

cause harm

IPY Data Policy

“…the IPY Joint Committee requires that

IPY data, including operational data

delivered in real time, are made available

fully, freely and on the shortest feasible

timescale.”

http://www.ipy.org/Subcommittees/final_ipy_data_policy.pdf

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200615 QuickTime™ and aGraphics decompressor

are needed to see this picture.

An IPY Data Management Workshop

• More than 40 participants from 13 countries

• Major goal: determine functions, form, and implementation for an IPY Data and Information Service

• Full report at

http://nsidc.org/ipydis

Photo courtesy SJS Khalsa

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200616 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Reference Documents

google “icsu paa” earthobservations.org

ISO 14721:2003

google “oais”

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200617 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Overarching themes

• Outreach to the scientific community• Data discovery and access• Interoperability• A data coordination office• A phased approach• Funding

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200618 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Vision: a cultural shift in science

“Preserve or Perish”

You are not finished until you have done the research, published the results, and published the data, receiving formal credit for everything.

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200619 QuickTime™ and aGraphics decompressor

are needed to see this picture.

catalog 3(Mirror)

catalog 2

catalog 1

catalog 9

catalog 4

catalog 8

catalog 7

catalog 6(Mirror)

catalog 5

Data Discovery & Access—the “Union”Catalog

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200620 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Data Discovery & Access

• Data policy on free and open access• Working with the ICSU CODATA Global

Information Commons for Science Initiative to handle IPR issues with local and traditional knowledge.

• Visualization

18 May 2006

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200622 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Interoperability

“What few things must be the same so everything else can be different.”

• A few good standards: • ISO19115 metadata• Open Geospatial Consortium

• Explore advanced semantic approaches

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200623 QuickTime™ and aGraphics decompressor

are needed to see this picture.

The Equatorial Bias on a Spherical Earth

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200624 QuickTime™ and aGraphics decompressor

are needed to see this picture.

The Equatorial Bias on a Spherical Earth

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200625 QuickTime™ and aGraphics decompressor

are needed to see this picture.

Design for Durability

Data formats should• transparent• interoperable• extensible• compact

Systems should be simple and robust

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200626 QuickTime™ and aGraphics decompressor

are needed to see this picture.

A Phased Approach

Think BIG but start small

IPY provides a unique opportunity to revolutionize data management, but…

IPY is only 126 days away

IPY Data Management; Mark Parsons; CODATA06, 25 Oct. 200627 QuickTime™ and aGraphics decompressor

are needed to see this picture.

NOAA

http://nsidc.org/ipydis

Questions?