Embed Size (px)
Citation preview
JN 04/21/23
Knowledge Systems Lab
Med-LIFE:A System for Medical Imagery
Exploration
Joshua New
Erion Hasanbelliu
JN 04/21/23
Knowledge Systems Lab
Introduction
• What is Med-LIFE?
• What is image fusion?
• How do I teach the computer?
• How can I view the results?
JN 04/21/23
Knowledge Systems Lab
What is Med-LIFE?
• Med-LIFE is an application currently under development to use computer processing techniques to reduce medical personnel workload
• GUI designed with Qt• Image Processing with C (and VTK library)
JN 04/21/23
Knowledge Systems Lab
What is Med-LIFE?
• Consists of three processes (LIFE):– Learning of image attributes by the computer using
SFAM– Image Fusion of many image modalities into one
color image– Exploration of learning and fusion results
JN 04/21/23
Knowledge Systems Lab
What is Image Fusion?
• Allows the combination of multiple image modalities into one colored image with no information loss
• Reduces workload by eliminating the number of images a radiologist must analyze
• Images used from “The Whole Brain Atlas”– http://www.med.harvard.edu/AANLIB/home.html
JN 04/21/23
Knowledge Systems Lab
What is image fusion?
• Technique similar to primate vision
JN 04/21/23
Knowledge Systems Lab
Image Fusion Example
GADPD
SPECTT2Color Fuse Result
Image Fusion Example
JN 04/21/23
Knowledge Systems Lab
How do I teach the computer?
• SFAM – Simplified Fuzzy ARTMAP• SFAM is a computer-based system
capable of online, incremental learning• Two “vectors” are sent to this system for
learning:– Input feature vector tells what data is
available from which to learn– Supervisory signal tells whether that vector
is an example or counterexample
JN 04/21/23
Knowledge Systems Lab
How do I teach the computer?
• Left-click to define examples (green)• Right-click to define counterexamples (red)
Main Window Zoom Window
JN 04/21/23
Knowledge Systems Lab
How do I teach the computer?
• Supervisory signal from red/green marks• Feature vector from slice pixel values for
original, single, and double opponent images
JN 04/21/23
Knowledge Systems Lab
Learning Results
Main Window Results Zoom Window Results
JN 04/21/23
Knowledge Systems Lab
Learning Results
T2Main Window Results
JN 04/21/23
Knowledge Systems Lab
How can I view results?
• Display a plethora of information• Skull generated for patient from PD modality
for contextual slice navigation• Explore tab provides several functions:
– Original images– Fusion results imbedded within 3D, patient-
generated skull– Learning results
JN 04/21/23
Knowledge Systems Lab
Demo Presentation
• Erion will now demo the Med-LIFE system
JN 04/21/23
Knowledge Systems Lab
Conclusion
• Med-LIFE offers reduced workload to physicians who scan multiple images– Image processing and fusion reduces the
number of images to be analyzed– Learning system allows the computer to
perform prescreening or background analysis
– Exploration allows immersion within the data for surgery planning
