DoD Metadata RegistryDoD Metadata RegistryStatusStatus

Dr. Glenda HayesNCES Data Advisor

May 17, 2006

UNCLASSIFIED

2

Agenda

• DoD Net-Centric Data Strategy

• Data Strategy Implementation Actions

• Role for NCES Enablers

• DoD Metadata Registry

3

DoD Net-Centric Data Strategy

TrustedTrusted

InteroperableInteroperable

ResponsiveResponsive

AccessibleAccessible

UnderstandableUnderstandable

VisibleVisibleIs an information resource discoverable by most users?

Is it available on the network, and are tools readily available to use it?

Can it be intelligibly used? Are the semantics well documented?

Can it be combined or compared with other information? Can it be mediated?

Is the source, accuracy and currency of the data available to users?

Is the data what users need? Are robust user feedback mechanisms in place to improve it?

The DoD Net-Centric Data Strategy is the plan to make the Department’s information resources:

CC/S/As must institutionalize processes to accomplish these goals

4

Data Strategy Goals& Actions Required

Implement DOD Data Strategy per Directive

8320.2

Understandable TrustedAccessible Interoperable

• Identify System Assets to Expose

Determine Tagging Method & Technologies

Maintain Catalogs

Tag & Post Asset Info

Register/Publish Metadata

NCES enables via online services, interface specs and Software Development Kits

VisibleVisible Responsive

• Identify Assets for Access

• Select Applications

Provide Data Access Services

Post Assets

Register Service

Select/Create Taxonomy & Vocabulary

Develop Information Model & Register

Develop data Payload packages & Register

Create & Monitor Robust Feedback Mechanisms

Closely link Development & Ops

• Provide Access

• Usage Controls

• Manage Rights

Publish Data Asset Pedigree & Authoritative Source Designs

Register Metadata

Define & register Metadata Relationships

Identify Key System Interfaces

Comply with Net-Centric Interface Specs

Data Asset Sponsors, Data Asset Sponsors, Builders, and Builders, and

Operators: Specific Operators: Specific Actions RequiredActions Required

5

Enable Data To Be Understandable

“Secure the Building!” What does it mean?

– Navy: “Turn off the lights and lock the doors.”

– Army: “Surround the building, occupy, and control entry.”

– Marines: “Call in close air support, assault with small team, neutralize occupants, fortify and hold at all costs until properly relieved. SEMPER FI!”

and…

– Air Force: “Take out a three-year lease with option to buy.”

One reason Government Agencies and Military Services have trouble operating jointly is that they speak different languages.

Register Terms, Definitions, & Relationships

6

Etc.Tomcat

F-14

Support Data Interoperability• Interoperability Requires:

Physical Identity or Translation/Transformation Translate/Transform via neutral “mediation” schema

(to reduce “n-squared” point-to-point interface problem)

F14

F-14

F/14

Interoperable data thru “sameness”Interoperable thru translation via neutral schemaInteroperable “pair-wise” but inefficient

Register Data Translations

7

DoD Metadata Registry(MDR) and Clearing House

• “One Stop” Publish, Subscribe and Manage capabilities for Reusable Structural Metadata Components – 130k engineering artifacts (schema, stylesheet etc) registered as of 5/16– Includes translation logic for mediation & taxonomies – 7k Registered Users & Systems from DoD, IC, DHS, NASA and more– Unclassified, Secret and Top Secret instances operating– Organized by “Gallery”– Metrics

• Run Time support available – Web Services – ebXML capabilities

• User feedback driven– Online user-to-developer– DoD Metadata Working Group– V5 just released

http://metadata.dod.mil

8

MDR Accessibility

• Unclassified (Open)– NIPRNET w/Internet Access– http://metadata.dod.mil

• Unclassified (Sensitive)– Open Registry contents plus “password protected” components– NIPRNET with Internet Access– http://metadata.dod.mil

• Secret– Unclassified (Sensitive) content plus secret components– SIPRNET – http://diides.ncr.disa.smil.mil

• Top Secret (SCI) Managed by ICMWG– Secret content plus SCI components– JWICS

Unclassified (Sensitive)

Secret

Top Secret (SCI)

Unclassified (Open)

Users Discover and Pull metadata they are cleared for -

Synchronized Components on Multiple Networks

Engineering Components replicated from lower to higher security enclaves

9

MDR Support for Mediation

• Convert XML to XML

• Report status (degree of success/failure)schema

stylesheet

Legend

2004-2005-ATO.xsl(stylesheet)

2005-ATO.xsd(schema)

TransformsToXmlSchema

2005-2004-ATO.xsl(stylesheet)

2004-ATO.xsd(schema)

2005-ATO.xml(sample)

sample

HasXSLT

TransformsToXmlSchema

DescribedBy

XML Gallery OrganizesComponents for Mediation

HasXSLT

notional

Registered in DoD Metadata Registry

10

Message Feed

Client

Mediation listener

NCES Mediation Service Standards-based WS-I Basic Profile compliant web service to transform USMTF message to KML

CMPCMPCommon Message Processor APIs transform USMTF text message into XML format

XSLT stylesheet used to translate from USMTF schema to KML schema is retrieved from DoD Metadata Registry

Transformation is applied to create KML file. The result is returned to the client or stored on the Global Information Grid

Network links in Google Earth access the kml files and update positional information

NCES

MEDIATION

Mediation Use Case

11

1. Register structural metadata 2. Develop & register web services3. Develop applications

NCES Enabler:Service Oriented Architecture Foundation

ApplicationUse

Where are services

available for my users?

Developer

User

DoDMetadata Registry*

We

b Interface

Registeroperations

Service 2*

e.g. Sensor Tasking Service

Service 3*

e.g. Content Discovery

Service 1*

e.g. ATO access service

RegisterI/OStructure

What services are available for reuse

What structures are available for reuse?

ATO

ISR Task List

RegisterDbStructure

DDMSDDMS

DDMS

We

b Interface

NCES Service Registry*

* NCES Security Service

Warfighter, Intelligence, & Business User benefit indirectly

12

Using Discovered Content

Defense Knowledge

Online*

Federated S

earch

*

Federated S

earch

*F

ederated S

earch

*

Database

Information System

Data Collection

This database has data you are looking for

“Pull the data”

DoD MDR

Pull meaning, structure, & constraints

With access to the data source and the associated metadata, the user/application can make informed use of the data.

<IFF>F</IFF>

What does “F” Mean?

13

MDR Support for Taxonomies

PoliticalOrganization

TerroristOrganization

ForeignTerroristOrganization

AlQaida

MyCOItaxonomy

DoD Coretaxonomy

<ddms> : <Subject>…/MyCOI.owl#AlQaida</Subject>

</ddms>

Organization

UrCOItaxonomy

TerroristGroup

Producer View

Group

al-Qaeda

equals

equals

Consumer View

www.disa.mil

15

NCES Enabler:Content Discovery

Defense Knowledge

Online*

Other Portal

(e.g. Intellink-S)

Federated S

earch

*

Federated S

earch

*F

ederated S

earch

*

Search Web Service enables federated content searches

Database

Information System

Data Collection

Application

(machine-to-machine) DoD MDR

ServiceRegistry

Supporting roles

* NCES Security Service

Defense Knowledge Online is one way to use Content Discovery

16

Making Data Visible (1 of 2)

DDMS Attributes

Security

Title

Identifier

Creator

Publisher

Contributor

Date

Rights

Language

Type

Source

SubjectGeospatial Coverage

Temporal Coverage

Virtual Coverage

DescriptionFormat

DoD Discovery Metadata Specification (DDMS)

DDMS endorsed by Executive Order 13388

“Further Strengthening The Sharing Of Terrorism Information

To Protect Americans”

Data Catalog(historical)

DDMS: Leverages Industry Standard

****

*

*

* mandatory

17Federated Search Leverages Operational Catalogs

• Approach– Publish resource metadata (IAW DDMS)– Query & federate via NCES Discovery Services

• Applies to…– Documents – Publish resource metadata (DDMS) in Data Catalog(s)– Services

• Register web service operations in NCES Service Registry

• Register I/O structures in DoD Metadata Registry

Sharepoint

Make Data Visible (2 of 2)

COIData

Catalog

Enterprise Search

OperationalDB

ContentContentMgmtMgmt

SolutionSolution

ContentContentMgmtMgmt

SolutionSolution

Federated Search

Federated Search

Federated Search

Federated Search

DDMS

Unanticipatedconsumer

18

Leverage Registered Domain Sets by Linking To Core

GMIFPA(38) GMI

INCIDENT(241)

GMIPolitical Subdivision

(3784)

MSGAircraft Type

(2889)

GOPShip Type

(1339)

MSGOrdnance Type

(752)

INTMission Type

(476)

DoD Core Taxonomy