59
Model-Based Respiratory Motion Compensation for Image-Guided Cardiac Interventions Matthias Schneider Pattern Recognition Lab Friedrich-Alexander-University Erlangen-Nuremberg Imaging and Visualization Department (IM) Siemens Corporate Research, Princeton, NJ, USA February 8

Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Model-Based Respiratory Motion Compensation for Image-Guided Cardiac Interventions

Matthias Schneider Pattern Recognition Lab Friedrich-Alexander-University Erlangen-Nuremberg Imaging and Visualization Department (IM) Siemens Corporate Research, Princeton, NJ, USA

February 8

Page 2: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Outline

�   Medical Background

�   Motivation

�   Breathing Motion Compensation

�   Results

�   (Vessel Segmentation)

Page 3: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Medical Background

Page 4: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

>30 days Chronic Total Occlusion

20-30%

Page 5: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Percutaneous Coronary Intervention

<10%

Page 6: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Angiogram

CT Guidance Cardiac

CT

+

Page 7: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

ECG Gating

ECG

BP

ECG Gated Sequence

Page 8: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Live CTO Crossing

Page 9: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Static Workflow

Page 10: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Breathing Motion

[Segers1999]

Page 11: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Breathing Motion Model

Page 12: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

PCA

Page 13: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and
Page 14: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Model Estimation

Page 15: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Training Samples

A B

Page 16: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

ModelSpectrum

10.4

0.115 0.028 0.0077 0.0021 0.00088

98.6% 99.7%

Page 17: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

MotionModel

plane A plane B

first mode

second mode

Page 18: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Extended Clinical Workflow

Page 19: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Results

Page 20: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Phantom Experiments

Page 21: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

A B

Cardiac&Respiratory Motion

Page 22: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

A B

Respiratory Motion

Page 23: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Error Over Breathing Cycle

mean: 0.84±0.19 mm mean: 0.81±0.27 mm

Page 24: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

MonoPlane

Page 25: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Error Over Breathing Cycle

mean: 10.4±2.15 mm

mean: 0.89±0.22 mm

Page 26: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

CostFunction unconstrained

0

1

0.5

Page 27: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

CostFunction model-based

0

1

0.5

Page 28: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

CaptureRange 100%

50%

0%

3D TRE of initial guess

model-based

unconstrained

Page 29: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

ConvergenceSpeed 636

34 47

model-based

cost function evaluations

unconstrained

3 modes 2 modes

Page 30: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Da a Clinical

Page 31: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Accuracy 3D TRE [mm]

1.79 1.57

1.16 0.83

Case 1 Case 2

unconstrained

1.42

0.85

3 modes 2 modes

Page 32: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Guidewire

A B

Page 33: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Guidewire Simulation

Page 34: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Simulation 1 Simulation 2

Guidewire Simulation

Page 35: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

§  Breathing Motion Model provides better robustness and faster convergence

§  CT guidance under fluoroscopy with breathing

motion compensation becomes feasible

§  Downside: motion model requires proper training data

§  Outlook: §  Further clinical validation required §  Hardware-based guidewire tracking §  Breathing phase prediction §  Affine registration to further improve results

Conclusion

Page 36: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

ThankYou

Page 37: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and
Page 38: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

References �   Alejandro F. Frangi, Wiro J. Niessen, Koen L. Vincken, and Max A. Viergever. Multiscale vessel

enhancement filtering. In MICCAI, volume 1496/1998, pages 130–137, 1998

�   Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and Ron Kikinis. 3D multi-scale line filter for segmentation and visualization of curvilinear structures in medical images. In Medical Image Analysis, volume 2, pages 143–168, Jun 1998.

�   Tony Lindeberg. Edge detection and ridge detection with automatic scale selection. International Journal of Computer Vision, 30(2):117–156, 1998.

�   W.P. Segars,et al. A realistic spline-based dynamic heart phantom. In IEEE Trans. Nucl. Sci., 1999.

�   H. Sundar, A. Khamene, Ch. Xu, F. Sauer, and Ch. Davatzikos. A novel 2D-3D registration algorithm for aligning fluoroscopic images with pre-operative 3D images. In SPIE Medical Imaging, San Diego, USA, volume 6141, Feb 2006.

�   G. Shechter and et al. Respiratory motion of the heart from free breathing coronary angiograms. Medical Imaging, IEEE Trans. on, 23(8):1046–1056, Aug. 2004.

�   G. Shechter and et al. Displacement and velocity of the coronary arteries: cardiac and respiratory motion. Medical Imaging, IEEE Trans. on, 25(3):369–375, March 2006.

�   K. McLeish and et al. A study of the motion and deformation of the heart due to respiration. Medical Imaging, IEEE Trans. on, 21(9):1142–1150, Sept. 2002.

�   D. Manke and et al. Model evaluation and calibration for prospective respiratory motion correction in coronary MR angiography based on 3-D image registration. Medical Imaging, IEEE Trans. on, 21(9):1132–1141, Sept. 2002.

�   A. P. King and et al. A technique for respiratory motion correction in image guided cardiac catheterisation procedures. Medical Imaging, 6918(1):691816, 2008.

Page 39: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

(model dimension )

Training Data

Covariance Matrix

Normalization

ModelEstimation

Motion Model

(component-wise)

(rigid transform per frame)

Eigenanalysis

Page 40: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Training Samples Case 1, LCA

A B

Page 41: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Case 2 RCA

A B

Page 42: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Static Workflow

Page 43: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Vessel Enhancement

Page 44: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Methods

 Matched filter  Directional filter  Shape driven  Hessian measures

Page 45: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Hessian

Eigenanalysis

Page 46: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Geometric Interpretation

[Frangi1998]

Page 47: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Vesselness Measures

Page 48: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Original Frangi Sato

Results

Page 49: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and
Page 50: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Geometric Interpretation

[Frangi1998]

Page 51: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and
Page 52: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Global Vessel Segmentation

1. Hessian based second order information

2. Vesselness measure (arbitrary)

3. Vector field integration inside vessel

  Seed point

  Smoothness + Vesselness constraint

→ Streamline bundles

Page 53: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Results

Original Vesselness Streamlines

Page 54: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Geometric Post-Processing

Page 55: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Streamlines Length Map Density Map

Length & Density

Page 56: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Streamlines

Centerline Extraction

Centerline

Original

Page 57: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Catheter Removal

Streamlines Catheter Correction Original

Page 58: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Robustness

Vesselness Streamlines Original + noise

Page 59: Model-Based Respiratory Motion Compensation for Image ...€¦ · Yoshinobu Sato, Shin Nakajima, Nobuyuki Shiraga, Hideki Atsumi, Shigeyuki Yoshida, Thomas Koller, Guido Gerig, and

Conclusion (2)

  Automatic global vessel segmentation

  Applicable for any local probability-like vesselness map

  Global geometric shape information allows for advanced post-processing

  Future Work: Classification of the main branches