1 UNC, Stat & OR SAMSI AOOD Opening Workshop Tutorial OODA of Tree Structured Objects J. S....

UNC, Stat & OR

SAMSI AOOD Opening WorkshopSAMSI AOOD Opening Workshop

Tutorial

OODA of Tree Structured Objects

J. S. Marron

Dept. of Statistics and O. R., UNC

April 10, 2023

UNC, Stat & OR

Workshop Big PictureWorkshop Big Picture

An investment by:

• Provided Funding to Bring Us Together

• Has Specific Goal:Generating Collaborative Research

UNC, Stat & OR

An investment by:

Workshop Aim:Kickoff Ongoing Research

(through whole program year)

UNC, Stat & OR

Thus different format:

• Fewer Main Talks

• Main Talks Aimed at Collaborations

• “2-Minute Madness” Talks –

Introductory

• Wed. Afternoon: Form “Working

Groups”

UNC, Stat & OR

Working GroupsWorking Groups

Usual Structure

• Conceived of at Opening Workshop

• Agreed upon on Wednesday

Afternoon

• First Meeting: Thursday or Friday

• Followed by weekly meetings

• Can Skype or WebEx in remotely

UNC, Stat & OR

Goals:

• Collaborative Research

• Among unexpected partners

Our hope:

• This group unusually well suited for

UNC, Stat & OR

Program “Areas of Emphasis”:

• Functional Data Analysis• Time Dynamics• Image Analysis• Trees as Data• Shape and Manifold Data

Where are potential (new) connections?

UNC, Stat & OR

• Functional Data Analysis• Time Dynamics• Image Analysis• Trees as Data• Shape and Manifold Data

UNC, Stat & OR

• Functional Data Analysis• Time Dynamics• Image Analysis• Trees as Data DTI• Shape and Manifold Data

UNC, Stat & OR

• Functional Data Analysis• Time Dynamics• Image Analysis Brain

Development• Trees as Data • Shape and Manifold Data

UNC, Stat & OR

• Functional Data Analysis• Time Dynamics “Atlas” of Human

Body• Image Analysis• Trees as Data • Shape and Manifold Data

UNC, Stat & OR

Requests of you:• Look for more of these• Discuss with others • Bring up on Wednesday Afternoon• Join in on Thursday +

UNC, Stat & OR

Object Oriented Data Object Oriented Data AnalysisAnalysis

What is the “atom” of a statistical analysis?

• First Course: Numbers• Multivariate Analysis: Vectors• Functional Data Analysis: Curves• OODA: More Complicated Objects

• Images• Movies• Shapes• Tree Structured Objects

UNC, Stat & OR

An Aside on AcronymsAn Aside on Acronyms

What is it?

OODAor

UNC, Stat & OR

SAMSI AOOD Opening WorkshopSAMSI AOOD Opening Workshop

Tutorial

OODA of Tree Structured Objects

J. S. Marron

Dept. of Statistics and O. R., UNC

April 10, 2023

UNC, Stat & OR

Acronym HistoryAcronym History

Original SAMSI Proposal:Object Oriented Data Analysis

(OODA)

UNC, Stat & OR

Original SAMSI Proposal:Object Oriented Data Analysis

(OODA)

SAMSI Directors’ Suggestion:Analysis of Object Oriented Data

(AOOD)

UNC, Stat & OR

Original SAMSI Proposal:Object Oriented Data Analysis (OODA)

SAMSI Directors’ Suggestion:Analysis of Object Oriented Data

(AOOD)

NISS Board Suggestion:Analysis Of Object Data (AOOD)

UNC, Stat & OR

An Aside on AcronymsAn Aside on Acronyms

What is it?

OODAor

Suggestion: Treat these as synonyms

UNC, Stat & OR

Object Oriented Data Object Oriented Data AnalysisAnalysis

What is the “atom” of a statistical analysis?

• First Course: Numbers• Multivariate Analysis: Vectors• Functional Data Analysis: Curves• OODA: More Complicated Objects

• Images• Movies• Shapes• Tree Structured Objects

UNC, Stat & OR

Euclidean Data SpacesEuclidean Data Spaces

Data are vectors, in

Effective (and Traditional) Analysis:• Linear Methods• Mean• Covariance• Principal Component Analysis• Gaussian Distribution

UNC, Stat & OR

Euclidean Data SpacesEuclidean Data Spaces

Data are vectors, in

Challenges:• High Dimension, Low Sample Size

(Classical Methods Fail)• Visualization:

• Find Structure (Expected & Unknown)• Understand range of “normal cases”• Find anomalies

UNC, Stat & OR

Non - Euclidean Data Non - Euclidean Data SpacesSpaces

“Simple” Example: m-reps for shapes• Data involve angles• Thus lie in “manifold”• i.e. “curved feature space”• Typical Approach:

Tangent Plane Approx.• e.g. PGA• Personal Terminology:

“Mildly non-Euclidean”

UNC, Stat & OR

PGA for m-reps, Bladder-Prostate-Rectum

Bladder – Prostate – Rectum, 1 person, 17 days

PG 1 PG 2 PG 3

(analysis by Ja Yeon Jeong)

UNC, Stat & OR

PG 1 PG 2 PG 3

UNC, Stat & OR

PG 1 PG 2 PG 3

UNC, Stat & OR

Non - Euclidean Data Non - Euclidean Data SpacesSpaces

What is “Strongly Non-Euclidean” Case?

Trees as Data

Special Challenge:

• No Tangent Plane

• Must Re-Invent

Data Analysis

UNC, Stat & OR

Strongly Non-Euclidean Strongly Non-Euclidean SpacesSpaces

Trees as Data Objects

From Graph Theory:

• Graph is set of nodes and edges• Tree has root and direction

Data Objects: set of trees

UNC, Stat & OR

Motivating Example:

• From Dr. Elizabeth Bullitt• Dept. of Neurosurgery, UNC

• Blood Vessel Trees in Brains

• Segmented from MRAs

• Study population of trees

Forest of Trees

UNC, Stat & OR

Blood vessel tree dataBlood vessel tree data

Marron’s brain:

MRI view

Single Slice

From 3-d Image

UNC, Stat & OR

Marron’s brain:

MRA view

“A” for

“Angiography”

Finds blood

vessels

(show up as white)

Track through 3d

UNC, Stat & OR

Marron’s brain:

MRA view

“A” for

“Angiography”

Finds blood

vessels

(show up as white)

Track through 3d

UNC, Stat & OR

Marron’s brain:

MRA view

“A” for

“Angiography”

Finds blood

vessels

(show up as white)

Track through 3d

UNC, Stat & OR

Marron’s brain:

MRA view

“A” for

“Angiography”

Finds blood

vessels

(show up as white)

Track through 3d

UNC, Stat & OR

Marron’s brain:

MRA view

“A” for

“Angiography”

Finds blood

vessels

(show up as white)

Track through 3d

UNC, Stat & OR

Marron’s brain:

MRA view

“A” for

“Angiography”

Finds blood

vessels

(show up as white)

Track through 3d

UNC, Stat & OR

Marron’s brain:

From MRA

Segment tree

of vessel segments

Using tube tracking

Bullitt and Aylward (2002)

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Now look over many people (data

objects)

Structure of population (understand

variation?)

PCA in strongly non-Euclidean Space???

, ... ,,

UNC, Stat & OR

Examples of Potential Specific Goals

(not accessible by traditional methods)

• Predict Stroke Tendency (Collateral

Circulation)

• Screen for Loci of Pathology

• Explore how age affects connectivity

, ... ,,

UNC, Stat & OR

Big Picture: 3 Approaches

1.Purely Combinatorial

2.Folded Euclidean

3.Dyck Path

UNC, Stat & OR

2.Folded Euclidean

3.Dyck Path

UNC, Stat & OR

Possible focus of analysis:

• Connectivity structure only (topology)

• Location, size, orientation of segments

• Structure within each vessel segment

, ... ,,

UNC, Stat & OR

Present Focus:

Topology only Already challenging Later address additional challenges By adding attributes

(locations, thicknesses, curvature, …) To tree nodes And extend analysis

UNC, Stat & OR

Topological Representation: Each Vessel Segment (up to 1st

Split)

is a node Split Segments are child nodes Connecting lines show

relationship

UNC, Stat & OR

Graphical Concept: Support Graphical Concept: Support TreeTree

The union of all trees in data set T.

Consists of the nodes in any tree of T

UNC, Stat & OR

Support Tree ExampleSupport Tree Example

Data trees:

Support tree:

UNC, Stat & OR

Recall from above:

Marron’s brain:

Focus on back

Connectivity (topology) only

(also consider right & left)

UNC, Stat & OR

Present Focus:

Topology only

Raw data as trees

Marron’s

reduced tree

Back tree only

UNC, Stat & OR

Topology only

E.g. Back Trees

Full Population

Study as movie

Understand

variation?

UNC, Stat & OR

Statistics on Population of Tree-Structured Data Objects?

• Mean???• Analog of PCA???

Strongly non-Euclidean, since:• Space of trees not a linear space• Not even approximately linear

(no tangent plane)

UNC, Stat & OR

Mildly Non-Euclidean Mildly Non-Euclidean SpacesSpaces

Useful View of Manifold Data: Tangent Space

Center:Frechét Mean

Reason forterminology“mildly nonEuclidean”

UNC, Stat & OR

Mean of Population of Tree-Structured Data Objects?

Natural approach: Fréchet mean

Requires a metric (distance)

on tree space

2,minarg

UNC, Stat & OR

Appropriate metrics on tree space:

Wang and Marron (2007)

• For topology only (studied here):• Use Hamming Distance

• Just number of nodes not in common

• Gives appropriate Fréchet mean

UNC, Stat & OR

Hamming DistanceHamming Distance

The number of nodes in the symmetric difference of two trees.

An example:

UNC, Stat & OR

Hamming DistanceHamming Distance

The two trees drawn on top of each other:

Common nodes: 2

Nodes only in blue tree: 4Nodes only in red tree: 2

So, distance: 4+2=6

UNC, Stat & OR

PCA on Tree Space?• Recall Conventional PCA:• Directions that explain structure in

• Data are points in point cloud• 1-d and 2-d projections allow insights

about population structure

UNC, Stat & OR

Illust’n of PCA View: PC1 Illust’n of PCA View: PC1 ProjectionsProjections

UNC, Stat & OR

Illust’n of PCA View: Projections on PC1,2 Illust’n of PCA View: Projections on PC1,2 planeplane

UNC, Stat & OR

PCA view: Lung Cancer Microarray PCA view: Lung Cancer Microarray Data Data

UNC, Stat & OR

PCA on Tree Space?

Key Idea (Jim Ramsay):

• Replace 1-d subspace

that best approximates data

• By 1-d representation

that best approximates data

Wang and Marron (2007) define notion of

Treeline (in structure space)

UNC, Stat & OR

PCA on Combinatorial Tree Space?

In Depth Discussion Tuesday Afternoon:

UNC, Stat & OR

PCA for blood vessel tree PCA for blood vessel tree datadata

Individual (each PC separately) Scores

UNC, Stat & OR

Important Data Analytic Goals:

• Understand impact of age (colors)

• Understand impact of gender

(symbols)

• Understand handedness (too few)

• Understand ethnicity (too few)

See these in PCA?

UNC, Stat & OR

Data Analytic Goals: Age, Gender

these?

UNC, Stat & OR

Directly study age PC scores

UNC, Stat & OR

• Take Deeper Look

• By Fitting Lines

• And doing Hypotest of H0: slope = 0

• Show p-values to assess significance

Compare Thickness & Descendants Corr.

UNC, Stat & OR

- Not Sig’t

UNC, Stat & OR

- Left Sig’t

UNC, Stat & OR

Conclusions:

- No Strong Age Connection

- Significant Connection for:

- Descendants

- Left

UNC, Stat & OR

Overall Impression:

Interesting OODA Area

Much to be to done:

• Refined PCA

• Alternate tree lines

• Attributes (i.e. go beyond topology)

• Classification / Discrimination (SVM, DWD)

• Other data types (e.g. lung airways…)

UNC, Stat & OR

Smoothing in Tree SpaceSmoothing in Tree Space

Question:

How does tree structure change with age?

Approach:

(Gaussian) Kernel Smoothing

UNC, Stat & OR

Smoothing in Tree SpaceSmoothing in Tree Space

UNC, Stat & OR

Smoothing on Tree Space?

UNC, Stat & OR

2.Folded Euclidean

3.Dyck Path

UNC, Stat & OR

Folded Euclidean ApproachFolded Euclidean Approach

People:

• Scott Provan

• Sean Skwerer

• Megan Owen

• Martin Styner

• Ipek Oguz

UNC, Stat & OR

Setting: Connectivity & Length

Background: Phylogenetic Trees

Major Restriction: Need common

leaves

Big Payoff: Data space nearly

Euclidean

UNC, Stat & OR

Euclidean

UNC, Stat & OR

Euclidean

UNC, Stat & OR

Euclidean

UNC, Stat & OR

Major Restriction: Need common

leaves

Approach:

• Find common cortical landmarks

(Oguz)

corresponding across cases

• Treat as pseudo – leaves

by projecting to points on tree

(draw pic)

UNC, Stat & OR

Marron’s brain:

From MRA

Reconstruct trees

Rotate to view

UNC, Stat & OR

Vessel LocationsVessel Locations

UNC, Stat & OR

Common ColorCommon Color

UNC, Stat & OR

100100

UNC, Stat & OR

Cortical Surface & Cortical Surface & LandmarksLandmarks

101101

UNC, Stat & OR

102102

UNC, Stat & OR

103103

UNC, Stat & OR

104104

UNC, Stat & OR

105105

UNC, Stat & OR

106106

UNC, Stat & OR

Landmarks and VesselsLandmarks and Vessels

107107

UNC, Stat & OR

108108

UNC, Stat & OR

109109

UNC, Stat & OR

110110

UNC, Stat & OR

111111

UNC, Stat & OR

112112

UNC, Stat & OR

Attach Landmarks & Attach Landmarks & SubtreesSubtrees

113113

UNC, Stat & OR

114114

UNC, Stat & OR

115115

UNC, Stat & OR

116116

UNC, Stat & OR

117117

UNC, Stat & OR

118118

UNC, Stat & OR

Highlight OprhansHighlight Oprhans

119119

UNC, Stat & OR

120120

UNC, Stat & OR

121121

UNC, Stat & OR

122122

UNC, Stat & OR

123123

UNC, Stat & OR

124124

UNC, Stat & OR

Trim OprhansTrim Oprhans

125125

UNC, Stat & OR

126126

UNC, Stat & OR

127127

UNC, Stat & OR

128128

UNC, Stat & OR

129129

UNC, Stat & OR

130130

UNC, Stat & OR

Final Tree (common Final Tree (common leaves)leaves)

131131

UNC, Stat & OR

132132

UNC, Stat & OR

133133

UNC, Stat & OR

134134

UNC, Stat & OR

135135

UNC, Stat & OR

136136

UNC, Stat & OR

• Next tasks: Statistical Analysis,

• Calculation of Mean

• Smoothing over time (w’td mean)

• PCA (“Backwards” approach???)

• Classification (“linear

method” ???)

• Work in Progress

• Heavy & Specialized Optimization

137137

UNC, Stat & OR

Statistics on Folded EuclideanTree Space?

138138

UNC, Stat & OR

2.Euclidean Orthant

3.Dyck Path

139139

UNC, Stat & OR

Dyck Path ApproachDyck Path Approach

People:

• Shankar Bhamidi

• Dan Shen

• Haipeng Shen

140140

UNC, Stat & OR

Setting:

• Start with connectivity only

• Second include lengths

• Should be generalizable

141141

UNC, Stat & OR

• Represent trees as functions

142142

UNC, Stat & OR

• Common device in probability

theory

• Used for limiting distributions

• Gives access to Brownian Motion

limits

143143

UNC, Stat & OR

• Common device in probability

theory

• Used for limiting distributions

• Gives access to Brownian Motion

limits

• Use “Functional Data Analysis”

• Familiar, Euclidean space

• Many methods available

144144

UNC, Stat & OR

145145

UNC, Stat & OR

Dyck Path Example

Example 1, Assume that we have three following tree data

Tree 1 Tree 2 Tree 3

146146

UNC, Stat & OR

Support tree: union of trees

Tree 1

147147

UNC, Stat & OR

Tree 1,2

148148

UNC, Stat & OR

Tree 1,2,3

149149

UNC, Stat & OR

Transform Tree to Curve

Now, we show how to transform the first tree as curve.

Tree 1/ Support Tree

150150

UNC, Stat & OR

151151

UNC, Stat & OR

152152

UNC, Stat & OR

153153

UNC, Stat & OR

154154

UNC, Stat & OR

155155

UNC, Stat & OR

156156

UNC, Stat & OR

157157

UNC, Stat & OR

158158

UNC, Stat & OR

159159

UNC, Stat & OR

160160

UNC, Stat & OR

Now, we show how to transform the second tree as curve.

161161

UNC, Stat & OR

162162

UNC, Stat & OR

163163

UNC, Stat & OR

164164

UNC, Stat & OR

165165

UNC, Stat & OR

166166

UNC, Stat & OR

167167

UNC, Stat & OR

168168

UNC, Stat & OR

169169

UNC, Stat & OR

170170

UNC, Stat & OR

171171

UNC, Stat & OR

Now, we show how to transform the third tree as curve.

172172

UNC, Stat & OR

173173

UNC, Stat & OR

174174

UNC, Stat & OR

175175

UNC, Stat & OR

176176

UNC, Stat & OR

177177

UNC, Stat & OR

178178

UNC, Stat & OR

179179

UNC, Stat & OR

180180

UNC, Stat & OR

181181

UNC, Stat & OR

182182

UNC, Stat & OR

Some Brain Data PointsSome Brain Data Points(as corresponding trees)(as corresponding trees)

183183

UNC, Stat & OR

184184

UNC, Stat & OR

185185

UNC, Stat & OR

186186

UNC, Stat & OR

187187

UNC, Stat & OR

188188

UNC, Stat & OR

Raw Brain Data (as curves)Raw Brain Data (as curves)

189189

UNC, Stat & OR

Raw Brain Data - ZoomedRaw Brain Data - Zoomed

190190

UNC, Stat & OR

Raw Brain Data - ZoomedRaw Brain Data - Zoomed

191191

UNC, Stat & OR

1 UNC, Stat & OR SAMSI AOOD Opening Workshop Tutorial OODA of Tree Structured Objects J. S....

Documents

OODA Loop: A Drive Toward Understanding

ODD: OODA Evolution

Boyd’s OODA Loop - WordPress.com · OODA loop, the loop does provide a concise framework for improving competitive power throughout an organization. Much of this power will be lost,

OODA, Build Measure Learn, and Lean Startups

OODA for businesses

OODA loop problem solving

Лора А. Янда UNC-Chapel Hill janda@unc , unc/~lajanda

SplusIgroup Warriors-OODA Tutorial Final

Boyd’s OODA Loop - fasttransients.files.wordpress.com · OODA loop (Osinga 2005). The acronym “OODA” stands for “observe, orient, decide, act,” and it is often depicted

Boyd’s Real OODA Loop and Fencing By Nicholas J. Johnson

Cyber Integration for Fusion Centers - OODA Loop

BULON C/EXAG. DE ACERO PULIDO ROSCA GRUESA UNCbuloneradelsursa.com.ar/bds/images/catalogo/CATALOGO BULONES.pdf · rosca unc unc unc unc unc w unc unc unc unc unc unc hilos 24 20 18

1 UNC, Stat & OR SAMSI OODA Workshop SAMSI OODA Workshop Dyck path correspondence and the statistical analysis of Brain vascular networks Shankar Bhamidi,

Tugas Kelompok Aood Ok

The M-OODA: A Model Incorporating Control Functions And ... · Decision Support Systems Section ... The M-OODA incorporates explicit control and flow components more in line with

Boyd's Real OODA Loop

A Hoop Through the OODA Loop

OODA Notes

ALTERNATIVAS DE OTIMIZAÇÃO DO CICLO OODA NO … · 2016-06-15 · alternativas na literatura sobre busca da Superioridade de Informação, que entrem no escopo do Ciclo OODA.

Frame Reflection:A Critical Review of US Military - OODA