Digital Twin-Inspired Models of Socio-Technical Systems:

A New Implementation of Work-Practice Modeling for Air Combat Simulation

William ClanceyInstitute for Human & Machine Cognition, Pensacola, FL USA

Benjamin Bell, Fritz Ray, Kristin WoodEduworks Corporation, Corvallis, OR USA

Winston Bennett, Jr.Air Force Research Laboratory, Wright-Patterson AFB, OH USA

IT2EC 2020

Problem Summary• Tactical simulations need to include training to:

– detect, counter, fight through adverse effects of disruptions to comms, sensors, nav

• Requires modelling how people/systems interoperate

– Both nominal and denied conditions

• Requires expanded notion of “digital twin” construct

– Need modeling approach and computational tool

– Train proficiency in denied/contested environments

– Simulate socio-technical processes/interdependencies

1IT2EC 2020

Digital Twin Approach

• Digital Twin:– Virtual model that mirrors physical world persons, devices, systems or processes

• Expand beyond single entity behaviors to interactions, interdependencies– Model how contested/denied environments disrupt a discrete digital twin agent– Simulate & predict adverse effects of resulting lapses on systemic effectiveness

• Implementation of enhanced digital twin approach– Brahms: Agent-based modeling framework, developed by the US Government– Socio-cognitive theories of perception, inference, communication, collaboration– Activity-based approach represents how functions are carried out in practice– Emphasizes interactive behavior among people, systems, and the environment

2IT2EC 2020

Supports simulating emergent outcomes for analysis, experimentation, training

Brahms-Lite: A Re-Implementation

• Benefits of activity-based theoretical construct– Simulate communication, interaction w/automated systems– Can model normal & degraded coordination, comm, systems

• Limitations– Modeling language is specialized w/only a few developers– Performance can be poor (esp. with realtime simulations)– Unsupported

• Solution: Migrate Brahms’ goodness to modern dev environment– Preserve activity-based theoretical construct– Retain basic data structures and process models– Platform for work practice modeling of socio-technical agents

3IT2EC 2020

Case Study: Brahms-Lite forAir-to-Air Combat Agents

• Not-So-Grand-Challenge (NSGC)– AKA “Rapid Agent Development Framework”

– Testbed for techniques to create CGFs generalizable across agent architectures

– Common context for model development and demonstration

– Goal: use real world data in the model development process

– Test domain for NSGC is air-to-air combat, using 2-v-2 tactical scenarios.

• Brahms approach to work practice modeling well-suited to NSGC– Can model multiple interdependencies in a tactical combat sortie

– Can capture systems (sensors, weapons, navigation and communication)

• Integrated models with NSGC testbed – Dashboard presents a tactical map and system status

– Panels show digital twin actions and communications

4IT2EC 2020

Emergent Behaviors fromBasic Brahms Constructs

• Brahms-Lite used to model realistic pilot behaviors– Replicated Brahms’ data structures (work frames, thought frames)– Adopted Brahms’ process models (beliefs, actions)

• Top-Level Decision Activity:– When I am Bingo Fuel, RTB– When I am in weapons range (40 nm) then run Combat Activity.– When I am inside the enemy bracket, beam out of the bracket– When my lead is too far (15 nm or 15000 ft) away, then head towards lead

• Combat Activity:• Conditions to fire in a head-on target aspect:

– Target is a bandit– I have weapon to fire– They do not have a weapon inbound, unless they are the last remaining enemy– They are > 160 AA– I am in their > 90 AA.– Range: < 35 NM (AA-10C); < 23 NM (AA-10A)– Vertical Separation: < 12,000’ (AA-10C); < 10,000’ (AA-10A)

• When there is an enemy, target/dogfight based on targeting logic

5IT2EC 2020

Anatomy of a Dashboard

6IT2EC 2020

Dashboard: Map

• Google Map API

• Displays alerts for weapons fired, weapons in bound

• Visually cues destroyed a/c

7IT2EC 2020

Dashboard: Blue

Targeted

In WEZ

ThreatenedWeps Inbound

Spiked

Steam Gauges for Quick SA

8IT2EC 2020

Dashboard: Red

Comms

Cognition

Fuel/Weapons/Track List

9IT2EC 2020

Dashboard: ConsoleRed2 kills Blue2, merges on other Blue

10IT2EC 2020

Results• 2-v-2 scenarios, models from 8 different agent tools

– Agent performance evaluated across nine dimensions

– Brahms-Lite model earned highest overall score & highest scores in 7 of 9 dimensions

11

Red2 kills Blue2, merges on other Blue

IT2EC 2020

Results: Target Selection Example

12

Red Target Selection

IT2EC 2020

Results: Expend weps, flow, RTB

13

Expend weapons, flow, RTB

IT2EC 2020

Conclusion (1): Brahms-Lite Architecture

• Modern, supported infrastructure– Java-script dev & run-time environment

• Implements key elements of Brahms– Workframes, thoughtframes activities

– Brahms process model (Pandora-inspired)

– Actions instantaneous, interrupting, co-exist if not conflicting

• Benefits– Improved performance

– Transparent interoperability

– Better extensibility and maintainability

14IT2EC 2020

Conclusion (2)

• Digital twin approach can be enhanced by modeling work practices – Model team coordination, comms, disruptions, denied environments

– E.g. manned/unmanned interactions; deconfliction across air control agencies

– Enabled by Brahms-Lite, Dashboards, Maps

• Brahms model and underlying theory of work practice modelling– Captures socio-technical system interactions & interdependencies

– Modern engine to scale technique to broader digital twin interpretations

• Promising early results w/digital twin models for air combat agents

• Broadly applicable to other domains– Simulations of complex environments under nominal/denied conditions

– Supports Reality-Simulation-Reality/Train, Reflect, Learn and Train Again

15IT2EC 2020