Environmental Visualization (EVIS) and Horizontal Fusion David Jones

1

EVISEVIS

Environmental Visualization (EVIS)and Horizontal Fusion

David JonesApplied Physics Lab, University of Washington

2

EVISEVISPaper Co-authors

D. Jones, K. Kerr, B. Kirby, R. Carr

Applied Physics Laboratory, University of Washington

J. Cook, T. Tsui, D. Brown, R. Mantri

Naval Research Laboratory, Monterey, CA

J. Ballas, J. Stroup, K. Wauchope, L. Aker

Naval Research Laboratory, Washington

3

EVISEVISPresentation Outline

• EVIS Background

– Human Systems Study

– EVIS & KSA FNC • Horizontal Fusion• EVIS & HF

– Goals– Architecture– Portlet Interface

• Some Lessons Learned

4

EVISEVISParticipating Organizations

• NRL-DC

• NRL-MRY

• APL-UW

• NUWC Newport

• SPAWAR SSC

• Paine College

University of WashingtonUniversity of Washington

5

EVISEVIS

EVIS BackgroundEVIS Background

6

EVISEVIS

Began as ONR 6.2 Effort to Investigate the Strike Forecasting “Interactive Information Model”

• Data Collection and Analysis

– Data from four “experiments”:• Two ashore under simulated conditions

• Two on USS CARL VINSON, one during COMPTUEX

– Data includes:• Real-time domain expert observations

• Time stamped recording of key events

• Video tapes and screen capture

• Initial Results

– Compiled into Tech Report

• Provided foundation for the FNC Project

7

EVISEVISAshore Experiments

• 3rd Fleet METOC Support Facility, San Diego

• USS CARL VINSON during pier side training

– Forecaster and Technician(s) tasked to develop a forecast for hypothetical air strike

– Video taped

– Real-time observations by domain experts

8

EVISEVIS

CCTV

Desk

Door

Storage (document)

IT21

Doo

r

NITESServer

NITESNT

NITESNT

NITESNT

IT21

IT21

Printer

SPA-25(Radar)

: Video Camera

CCTV

F: Forecaster

T: Technician

O: Project Observer

NITESServerRAID

Desk

: Workstation

NOWCOPIER Coffee

FILE

T

O

O

Wind

FILE

FILE

SMOOS

SMQ-11(Satellite)

: Chair

FIT21

T

T

: Port Hole

At Sea Observations: USS CARL VINSON during Battle Group training (COMPTUEX)

9

EVISEVISWeather Forecasting Stages, Trafton & Kirshenbaum

• Initialize / update large-scale mental model

• Build detailed Qualitative Mental Model (QMM)

• Verify and adjust QMM

• Make forecast

Stage Stage Durations Durations from from KirshenbaumKirshenbaum

InitializeInitialize Build Verify Build Verify ForecastForecast

10

EVISEVISEVIS & FNC

• Selected for participation in Knowledge Superiority Assurance Future Naval Capability (FNC) in FY02 (five year project)

• Objective: Integrate data, processing, and visualizations into accurate, responsive tactical knowledge for the warfighter

– Support effective, efficient workflow

– Support effective use of, and interaction with, mesoscale models

– Provide effective presentations to warfighters

11

EVISEVISTechnology Focus

Mission Impact Application that allowed enhanced user interaction

• User-Centered Design• Web enabled • Incorporate Java Web Start

Increase speed of updates• XML communications

– XML schema for rules & METOC data• Extendable product creation

– Web Publishing– TDA data ingestions

• NITES II transition

12

EVISEVIS

Time

EVISServices

Formulate Request

Rule Editor

RequestInterface

SpreadsheetEditor

ImageEditor

QC & ProductGeneration

Publish the Impact Information to

other Warfighters’ Systems (e.g.

REDS)

FORECASTERWebstart Client

Publish STRIKE Impact to

the Warfighters

Pull Master Rule Set &Use/modify

Accept Request and

Generate Impact

Information

Concept of Execution

13

EVISEVISArea & Forecast Time Selection

14

EVISEVISForecaster Value Added

15

EVISEVIS

EVIS & Horizontal Fusion (HF)EVIS & Horizontal Fusion (HF)

*Selected as an HF Initiative in FY04*Selected as an HF Initiative in FY04

16

EVISEVIS

What Is Horizontal Fusion?ASD NII Program

Horizontal FusionHorizontal Fusion is Net-Centric and focused on: is Net-Centric and focused on: (1) Data and cross-functional posting (1) Data and cross-functional posting • • Enables Ad Hoc access and fusion of dataEnables Ad Hoc access and fusion of data • • Created by integrated and federatedCreated by integrated and federated operations processesoperations processes (2) Making sense of that data.(2) Making sense of that data.

Federated OperationsFederated Operations

Integrated OperationsIntegrated Operations

FusionFusion

17

EVISEVIS

HF Objectives from GOAL TWO

• Populate the network with all data (intelligence, non-intelligence, raw and processed) • Consider that all users of information also are suppliers - post before you process • Improve sense making • Continuously surprise the enemy with the information we are using

HF Objectives from GOAL TWO

• Populate the network with all data (intelligence, non-intelligence, raw and processed) • Consider that all users of information also are suppliers - post before you process • Improve sense making • Continuously surprise the enemy with the information we are using

HF Objectives from GOAL ONE

• Secure and Assure the network and the information• Deploy collaborative capabilities and and other performance support tools

HF Objectives from GOAL ONE

• Secure and Assure the network and the information• Deploy collaborative capabilities and and other performance support tools

Power To The Edge

1. Make information available on a network that people depend on and trust

2. Populate the network with new, dynamic sources of information to defeat the enemy

3. Deny the enemy advantages and exploit weaknesses

1. Make information available on a network that people depend on and trust

2. Populate the network with new, dynamic sources of information to defeat the enemy

3. Deny the enemy advantages and exploit weaknesses

18

EVISEVIS

Horizontal Fusion Mission Space

Op-Intel

Ops Planning

Detailed Analysis

• Current Operational Picture• Holding Fleeting Targets

At Risk

Intelligence Preparationof the

Battlespace

• Support to Policy Development

• Treaty Enforcement

Main Focus

Export toOther Operating

Domains

Emphasis on support to War fighting operations

Operator-analyst Performance

Support

19

EVISEVIS

The Service Oriented Architecture (SOA) Paradigm

20

EVISEVIS

EVIS & Horizontal Fusion(One of 50+ Initiatives in FY04)

Issue Being Addressed:

Current tactical forecasting tools and processes do not provide accurate, timely planning support.

– Forecaster has many missions to support– Too much data to analyze– Tools that don’t work together– New technologies (mesoscale models) are

not utilized effectively– Information displayed to warfighter is not

easily understood

Objective:Develop, evaluate and transition environmental effects visualization capability with a warfighter focus (Become a HF Mission Effects Service)

– Produce forecasts that support tailored application of limited combat resources

– Present the right information: on time and accurate at every decision point

BrowserOffice

Distributed sources Forecaster Tactical user

Current Forecasting Process

EVIS Environmental Services (EMES)

Rapid Delivery of Tailored Mission Effects

AlternateEMES

ServiceTEDS

UserGUI

NRLCOAMPS-OS™

FNMOCSOAPXML

InformixConnect

InformixConnect

DPS

InformixConnect

SOAPXML

NRL Monterey

APL/UW

AlternateMap

Service

Future

Client

• Cataloging• Thumbnails• Maps / Zoom• Thresholding• Archiving• Web Publishing

Web StartPrimaryEMES

Service

REDS

SOAPXML

SOAPXML

http

Planner

21

EVISEVISMake Data & Services Available

• Service registry using Universal Description, Discovery, and Integration (UDDI) specification

• Federated Search > advance over Google

– Data providers provide information about their data & content using Registration Web Service (RWS)

– Search through the HF Collateral Space

The Results

• EVIS mission effects products can be found via natural language searches

• EVIS uses the system to make other METOC products searchable, such as the Battlefield Update Brief (BUB) Weather Impact brief developed by OWS 18

22

EVISEVISSecurity Issues

• A major focus of HF Program

– Cross domain accessibility

– One sign-on

– Role based access

– And many other requirements…

• Required significant effort

– System and software accreditation

– Multiple inspections

• Required to limit access to the application

– User > can see products

– User.analyst.weather > can make products

23

EVISEVIS

24

EVISEVIS AOI Selection via Portlet

25

EVISEVISRules Selection

26

EVISEVIS Threshold Product

27

EVISEVISSome Lessons Learned

• In cutting edge technology effort, a large program gives you access to a large pool of talented people, different approaches

• May be diverted from initial goals of the project in order to meet goals of the overarching program

• Requirement to use the standards of the larger program can reduce creativity

• Using open standards as they are still being developed causes increased complexity of the project

• A realistic focus on security requires more work than most people expect

• Limiting access to tools is counter-productive

28

EVISEVIS

Any Questions?Any Questions?