18
3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors Shaoting Zhang 1 , Junzhou Huang 1 , Mustafa Uzunbas 1 , Tian Shen 2 , Foteini Delis 3 , Xiaolei Huang 2 , Nora Volkow 3 , Panayotis Thanos 3 , Dimitris Metaxas 1 1 CBIM, Rutgers, The State University of New Jersey, Piscataway, NJ, USA 2 Computer Science and Engineering Department, Lehigh University, PA, USA 3 Brookhaven National Laboratory, NY, USA

3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

  • Upload
    monifa

  • View
    30

  • Download
    0

Embed Size (px)

DESCRIPTION

3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors. Shaoting Zhang 1 , Junzhou Huang 1 , Mustafa Uzunbas 1 , Tian Shen 2 , Foteini Delis 3 , Xiaolei Huang 2 , Nora Volkow 3 , Panayotis Thanos 3 , Dimitris Metaxas 1 - PowerPoint PPT Presentation

Citation preview

Page 1: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Shaoting Zhang1, Junzhou Huang1, Mustafa Uzunbas1, Tian Shen2, Foteini Delis3, Xiaolei Huang2, Nora Volkow3, Panayotis Thanos3, Dimitris Metaxas1

1 CBIM, Rutgers, The State University of New Jersey, Piscataway, NJ, USA2 Computer Science and Engineering Department, Lehigh University, PA, USA

3 Brookhaven National Laboratory, NY, USA

Page 2: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Motivations

• Rodents are often used as models of human disease.

• Use Magnetic Resonance Microscopy (MRM) to get 3D image for rodent brain.

• 3D segmentation of brain regions based on MR images of the rodent brain.

• Deformable model based segmentation.

Page 3: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Motivations

• Three challenges: 1) unclear boundary, 2) complex textures, 3) complex shape.

Page 4: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Relevant work

• Deformable model based segmentation– Deformable Models with Smoothness Constraints• Active contour [M. Kass, IJCV’88]• Gradient Vector Flow [C. Xu, TIP’98]• Deformable Superquadrics and Metamorphs [Metaxas

91,92; Huang, 08]

– Priors from training data• ASM [T.F. Cootes, CVIU’95]• 3D ASM [Y. Zheng, TMI’08]

4

Page 5: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Framework

Offline Learning

Geometry Processing

Shape Registration

Training Shapes PCA Shape

Statistics

Runtime Segmentation System

Input Image

Image Alignment

Volumetric Deformation

Shape Constraint Result

Page 6: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Build Shape Statistics

• Geometry processing (decimation, detail-preserved smoothing)

Nealen, et.al.: LMO, GRAPHITE’06

Page 7: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Build Shape Statistics

• Shape registration using AFDM

Shen, et.al.: AFDM, TMI’01

Page 8: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Build Shape Statistics

• PCA analysis (mean and variance)

Cootes, et.al.: ASM, CVIU’95

Page 9: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Deformation module

• Evolution of probability density function computed from region information

Huang, et.al.: Metamorphs, PAMI’08

Page 10: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Deformation module

• 3D Finite Element Method (A3D·V=LV)

Metaxas 92, Shen, et.al.: Active Volume Model, CVPR’09

Page 11: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Deformation module

A3D (smoothness)

Sorkine, et.al.: Laplacian Mesh Processing, EG’05

Page 12: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Proposed method-Framework, revisit

Input Image Image

Alignment

3D Metamorphs (AVM)

ASM Shape Refinement Result

Mean Mesh

Initialization

Shape Statistics

Reference Image

Initialization

Deformation

Page 13: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Experiments

• Settings– Adult male Sprague-Dawley rats– 21.1T Bruker Biospin Avance scanner– FOV of 3.4 × 3.2 × 3.0mm, voxel size 0.08mm– Data: 2/3 training and 1/3 for testing– All normal cases– Segment the cerebellum, the left and right striatum.– C++ and Python2.6 and tested on a 2.40 GHz Intel

Core2 Quad computer with 8G RAM.

Page 14: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Experiments

• Cerebellum (complex texture and shape details)

Our method

No prior

Page 15: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Experiments

• Striatum (unobvious boundaries)

Our method

No prior

Page 16: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Experiments

• p: sensitivity; q: specificity; DSC: dice similarity coefficient; RE-V: relative error of volume magnitude.

TP/(TP+FN)TN/(TN+FP)2TP/(2TP+FP+FN)

Page 17: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Conclusions

• Proposed a segmentation framework using 3D Metamorphs based deformation module and ASM based shape prior module.

• It is particularly useful when there are a limited number of training samples.

• In the future, we will test this algorithm on a larger dataset and also investigate how to segment multiple structures simultaneously and effectively.

Page 18: 3D Segmentation of Rodent Brain Structures Using Active Volume Model With Shape Priors

Thanks