20
Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

Embed Size (px)

Citation preview

Page 1: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

1

Segmentation of 3D Tubular Structures

Paul Hernandez-HerreraComputational Biomedicine Lab

Advisor: Ioannis A. Kakadiaris and Manos Papadakis

Page 2: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

2

Motivation

• Tubular structures appear in biomedical images– Neuron– Vessels– Coronary arteries– Airways

Page 3: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

3

Challenges• Size

Page 4: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

4

• Intensity

Challenges

Page 5: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

5

• Noise

Challenges

Page 6: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

6

• Contrast

Challenges

Page 7: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

7

1. Develop a binary segmentation algorithm able to– handle different sizes– work with any acquisition modality– deal with noise in the image– handle anisotropic images– do a fast segmentation– have minimum or null user interaction

Thesis Objectives

Page 8: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

8

Thesis Objectives

2. Develop a centerline algorithm able to– Correctly extract the morphology

• Handle overlapping structures• connect gaps

– Fast extraction

Page 9: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

9

PipelineInput:3D image stackRadius

Step 1:Background

voxels detection

Step 2:Feature

extraction

Step 3:Background

enhancement

Step 4:Segmentation

Page 10: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

10

Segmentation as one-class classification

Input:3D imageRadius

Detect voxels in background

Voxels with unknown label

Train a model(Cost function)

Feature vectors

Get cost value

Accepted as Background

Rejected as Background

These are foreground

voxels

Page 11: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

11

Step1: Background voxel detection

• Compute the Laplacian of the 3D image• The output has the following properties

1. Negative values in the foreground2. Value close to zero in the boundary3. It is positive near but outside the TS4. Ringing (positive and negative) in the background

Page 12: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

12

Step 2: Feature extraction• Feature vector

Eigenvalues of Hessian matrix

Page 13: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

13

Step 3: Cost function• Approximate feature vectors distribution

for background voxels• Normalize the distribution • Smooth the normalized distribution

Page 14: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

14

Step 3: Background enhancement

Input image Enhanced image

Page 15: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

15

Step 4: Segmentation

Enhanced image Segmentation

Page 16: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

16

Results: Multiphoton

Input Segmentation

Page 17: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

17

Results: Confocal

Input Segmentation

Page 18: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

18

Results: Brain vessels

Input Segmentation

Page 19: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

19

Ongoing work• Automatic radius estimation• Allow the proposed method to handle

any number of features• Centerline extraction

Page 20: Segmentation of 3D Tubular Structures Paul Hernandez-Herrera Computational Biomedicine Lab Advisor: Ioannis A. Kakadiaris and Manos Papadakis 1

20

Thanks

Thanks for your attention

QUESTIONS?