37
Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM Team November, 2013

Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Embed Size (px)

Citation preview

Page 1: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.1

National Information Exchange Model (NIEM) in JPS

David WebberPublic Sector NIEM Team

November, 2013

Page 2: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.2

The following is not intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.

The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Disclaimer Notice

Slide 2

Page 3: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.3

Agenda

Brief History of NIEM

NIEM, Open Data and Mobile

NIEM, Data Definitions Alignment & Analytic Services

Enabling Citizen Services Collaboration

Application Demonstration

Summary and Resources

Page 4: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.4

Brief History of NIEM

Page 5: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.5

NIEM turned 7 years old in April – Milestones

NIEM Chartered on April 19, 2005 with DHS/DOJ/HHS executive steering group

First Major Version: 1.0, published in 2006

Next Major Version: 2.0, published in 2007

Current Minor Version: 2.1 minor release, published in 2009

2013 - NIEM 3.0 released + NIEM UML profile

5

Page 6: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.6

DoD NIEM Adoption

NIEM military domain “will support development of information exchange specifications across the full range of military operations.”

NIEM will be used unless component can show compelling reasons

DoD Chief Information Officer Teri Takai :

Lt. Gen. Mark Bowman, Joint Chiefs of Staff CIO/J6

6

Page 7: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.7 7

FEDERAL AGENCY COMMITMENTS

AGENCY USE OF NIEMDepartment of Agriculture Committed to UseDepartment of Defense Committed to UseDepartment of Education Committed to UseDepartment of Energy Committed to UseDepartment of Health and Human Services Committed to UseDepartment of Homeland Security Committed to UseDepartment of Housing and Urban Development Committed to UseDepartment of Justice Committed to UseDepartment of Labor Committed to UseDepartment of State Committed to UseDepartment of the Interior Committed to UseDepartment of the Treasury Committed to UseDepartment of Transportation Committed to UseDepartment of Veterans Affairs Committed to UseEnvironmental Protection Agency Further Evaluation RequiredGeneral Services Administration Committed to UseNational Aeronautics and Space Administration Further Evaluation RequiredNational Archives and Records Administration Committed to UseNational Science Foundation Committed to UseNuclear Regulatory Commission Will Not UseOffice of the Director of National Intelligence Committed to UseSocial Security Administration Further Evaluation RequiredGeospatial Line of Business Will Not UseGrants Management Line of Business Further Evaluation RequiredFinancial Management Line of Business Committed to UseHuman Resources Line of Business Committed to Use

Page 8: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.8

The NIEM FrameworkNIEM connects communities of people who share a common need to exchange information in order to advance their missions, and provides a foundation for seamless information exchange between federal, state, local, and tribal agencies. Much more than a data model, NIEM offers an active user community as well as a technical and support framework.

Support FrameworkTechnical FrameworkCommunity

Formal Governance Processes

Online Repositories

Mission-Oriented Domains

Self-Managing Domain Stewards

Data Model

XML Design Rules

Development Methodology

Predefined Deliverables (IEPD)

Tools for Development and Discovery

Established Training Program

Implementation Support

Help Desk & Knowledge Center

Page 9: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.9

The NIEM Data Model

NIEM’s data model is a set of common, controlled, and approved XML data structures and definitions vetted through the Federal, State, Local, Tribal and Private Sectors.

Data elements are organized into core and domain-specific components

Core components are used by multiple domains and can be described by structure, semantics, and

definition universally

Domain-specific components are continually

updated by subject matter experts that are actual NIEM

participants and industry experts for their particular

domain

NIEM Naming and Design Rules (NDR)

specify how each of these components are defined

and utilized

Page 10: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.10

NIEM’s Domains ViewNEWEST DOMAINS

NIEM Government Resource

Management Domain

NIEM Health Domain

NIEM Human Services Domain

DOMAINS IN PLANNING

NIEM Agriculture

NIEM Education

NIEM Transportation

10

Page 11: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.11© 2012/13 Oracle Corporation – Restricted Distribution 11

Available XML Dictionaries NIEM Dictionaries

– CBRN dictionary– Emergency dictionary– Family dictionary– Immigration dictionary– Infrastructure dictionary– Intelligence dictionary– Justice dictionary– Maritime dictionary– Screening dictionary– Trade dictionary– Immigration blueprint– NIEM core dictionary

Available from download site

direct link:http://sourceforge.net/projects/camprocessor/files

XMLXML XMLXML XMLXML XMLXML XMLXML XMLXML

+ includes spreadsheets and sample models

Note: Those marked in bold are model style dictionaries with recursive components.

Page 12: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.12© 2012/13 Oracle Corporation – Restricted Distribution 12

NIEM Past and Present Challenges Vertical domain vocabulary for DHS and DOJ

One dozen domain dictionaries

Technology limited - built using XSD schema

Core components highly contextual to DHS/DOJ

Object model based – no actual logical models of information!

Gap with semantic technologies integration

Limited data content rules and code lists

Mapping automation support missing

Multi-year development life cycles

Page 13: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.13© 2012/13 Oracle Corporation – Restricted Distribution 13

SOA View - Information Sharing Stack and Rules Privacy and Policy

Automation

Identity and Access Management

Routing /

Process Flow

Standardized Metadata

Common Vocabulary

Validation Rules

Business Process, Enrichment, Routing Rules

Identity, Access Control, Classifications Rules

Privacy and Policy Automation Rules

NIEM: business rules important; not just data

Page 14: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.14© 2012/13 Oracle Corporation – Restricted Distribution 14

NIEM is still improving… Collections of complex XML Schema with verbose components Embedded context in names Currently facing significant scaling challenges

– Inconsistencies; too much manual management; slow lifecycles

Dictionary technology incubating Enhanced code lists mechanism incubating UML profile is evolving initiative with OMG

– Attempt to marry modelling techniques and XSD Schema syntax

Policy and Security mechanisms incubating Need to embrace enabling tools for rapid expansion of domains and

community collaboration

Page 15: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.15© 2012/13 Oracle Corporation – Restricted Distribution 15

Oracle and NIEM The Oracle NIEM team has been working with the DHS/DOJ/HHS NIEM

program for three years providing support and tools The Oracle toolkit for NIEM is the leading toolset for developing NIEM

solutions and integrating NIEM with Oracle product solutions Understanding what NIEM is today and then where the future of NIEM is

heading is critical for Oracle customers to see how they can leverage NIEM across their enterprise information exchanges

Oracle thought leadership and tools delivery is pivotal to success of NIEM and Open Data information sharing initiatives

Horizontal collaboration between DoD, DHS, DOJ, FBI, HHS strategically vital

Page 16: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.16© 2012/13 Oracle Corporation – Restricted Distribution 16

Example – Military Applicant Onboarding

Need to examine the applicants health history and particularly prescriptions

1 in 5 high schoolers today are abusing prescriptions Drug use leads to at-risk military personnel from in-theatre

adverse reactions and post-traumatic stress Nationally States are looking to share pharmacy records to reduce

prescription abuse, pill mills and rogue doctors– 1,000 people die each month from drug abuse in the US

– In California 80% of prescriptions are for non-residents

DOJ / BJA PMIX program – Prescription Medication Information eXchange – using NIEM

Page 17: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.17© 2012/13 Oracle Corporation – Restricted Distribution 17

Oracle Tools - Integrated Location Intelligence

Draw line around an area of interest and highlight all cases in area, and drill into details of a specific incidents.

Location information integrated with BI to allow analysis of incident patterns, geographical hot spots..

Page 18: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.18

NIEM, Open Data and Mobile

Page 19: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.19© 2012/13 Oracle Corporation – Restricted Distribution 19

Oracle Open Data Solution – Open-XDX

Open-XDX is an all new component designed to deliver

world class Open Data APIs

Integrates into Oracle Fusion Middleware foundation and

Database products

Uses rapid configuration templates and code-less methods

and open source NIEM tools

Allows plug-and-play delivery for Oracle customers and

applications

Page 20: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.20

Example – Chicago Pharmacy Vaccines Searchhttp://www.verifyxml.org

1. Socrata data extract

2. Oracle database

3. FMW4. Open-XDX5. Prime Faces

Combines: rapid development paradigm; open data approach; open

source tools; RESTful web services; community based resources and

delivery; NIEM-aligned information feeds; Results Geo-mapping

20

Page 21: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.21

Integration Conceptual ViewOpen XDX deployment

• Visual Editor • SQL Browser• Dictionaries• Drag and Drop

• Generate Data• Validate Data• Send Data

• Open XDX• Web Services• FMW / BPM / ADF• Glassfish / Netbeans

Design Test Deploy

DB

Web

Open XDX

CAMV

CAM EditorOpen XDX

• Device• Browser• Server

Data Delivery

SQL

XML

XML

SQL

FMW

Page 22: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.22

Mobile Device Interface – Activity Report

User can click here to allow sharing of the GPS coordinates from their phone location

User can browse and select phone camera image

Page 23: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.23

NIEM, Data Definitions Alignment & Analytic Services

Page 24: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.24

Dictionaries: Key Pillar of Information Sharing

Canonical XML Components DictionaryCanonical XML Components Dictionary11

Component Associations and CouplingsComponent Associations and Couplings22

Exchange Templates and RulesExchange Templates and Rules33

W3C Schema and Model RepresentationsW3C Schema and Model Representations44

Delivery Control, Messaging, SecurityDelivery Control, Messaging, Security55

Presentation

Collaboration

Services

Artefact

relationships

Implementation Artifacts and ExamplesImplementation Artifacts and Examples66

Navigation and Query Tools

Domains Reuse Library

Components

Automatic Rendering Tools

Deployment Environments and Middleware

XMLUser Inserts

Relationship Lookups

Template Catalog

Testing Workbench, Rules Engine, Data Samples, Integration ETL

Schema XMLModels Components

Canonical Dictionary Collections

Page 25: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.25© 2012/13 Oracle Corporation – Restricted Distribution 25

Available Dictionary Tools CAM toolkit provides a rich set of tools to create and manage dictionaries

– Bottom up harvesting of existing information assets

– Top down modelling and engineering

– Reuse scoring and comparison reporting Dictionary aligned with UN/CEFACT CCTS work

– Supports concepts and model

– Component renamer supports NIEM Naming and Design Rules Practical solution - supports desktop tools

– Support for Excel spreadsheet importing and exporting

– Can generate UML models

– Works with simple Mindmap rendering Dictionary Collections

– Create collaborative shared sets of dictionaries

Page 26: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.26© 2012/13 Oracle Corporation – Restricted Distribution 26

Value Proposition Allow business data analysts to focus on information needs and

build data exchanges Aligns information with industry standards and enterprise

information stores Ensures consistent usage and definitions using profile of syntax-

neutral terms and constructs Components can be derived from existing domain schema and data

structures Supports providing sharing and collaboration services Allows development of supporting analytics tools

Page 27: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.27© 2012/13 Oracle Corporation – Restricted Distribution 27

Public Safety Areas and Scope Crime Public Order Infrastructure

Gang Activity Public Events Community ThreatsNarcotics Community Threats Infrastructure ThreatsPrescription Drugs Abduction Threats Military InstallationWeapons Property Threats Travel/ImmigrationChemicals Personal Threats TerrorismVehicles Theft Weapons Internet

Transport/Goods Theft Chemicals Farms

Animals / Exploitation Biological Parks

Prostitution Emergency Response

Pornography

Internet

Fraud

Banking

Seemingly unconnected activity and participants provide key markers to intended criminal or terrorist patterns

Page 28: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.28

Example: SAR v2.0 (draft) content model• Cleaner and enhanced data model

• Extended capability and flexibility• Improved workflow alignment• Better internationalization support

NEW

NEW

NEW

Enhanced

Workflow

Controls

Legend:? Optional* Repeatable@ attribute# Properties

Page 29: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.29© 2012/13 Oracle Corporation – Restricted Distribution 29

Supports Analytics and Location Intelligence

Draw line around an area of interest and highlight all cases in area, and drill into details of a specific incidents.

Location information integrated with BI to allow analysis of incident patterns, geographical hot spots..

Page 30: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.30

Enabling Citizen Services Collaboration

Page 31: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.31

Application Demonstration

- Child Welfare Court Case

Page 32: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.32

Summary and Resources

Page 33: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.33© 2012/13 Oracle Corporation – Restricted Distribution 33

Oracle and NIEM Key mover advantage: Oracle NIEM expertise and tools Customer briefings "Understanding NIEM Today” learning the success

stories, best practices, and how to leverage NIEM Oracle BPM / SOA and NIEM - how to move from traditional long

development cycles to rapid and agile development for mission response Information Exchange Management

– Policy and Security

– Registry Repository metadata integration capabilities

Geospatial advantage with Oracle solutions Proof-of-concept pilot demonstration opportunities

Page 34: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.34

NIEM Tools - CAMeditor.org Project

SNAPSHOT OF PROJECT

ACTIVITIES

150,000+ CAMeditor.org page

visits to site

165+ countries have downloaded tools; 30% of visitors are

from U.S.;700+ downloads

weekly

2500+ student views of online video training

resources

8 languages now available

www.cameditor.orgwww.niemtrainingvideosorg 34

Page 34

Page 35: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.35

NIEM and Open Data (XML / JSON)SNAPSHOT OF

PROJECT ACTIVITIES

Showcase site for integration

exchanges using NIEM and Open Data

Global Test bed initiative for Information

Exchange (GITB) for Supplychain

www.VerifyXML.org

35

Page 36: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.36

NIEM Training

www.niemtrainingvideos.org

36

Page 37: Copyright © 2012, Oracle and/or its affiliates. All rights reserved. 1 National Information Exchange Model (NIEM) in JPS David Webber Public Sector NIEM

Copyright © 2012, Oracle and/or its affiliates. All rights reserved.37

Q & A