Embed Size (px)
Citation preview
Image Processing, Simulation and Cancer
University of CoimbraFaculty of Sciences and Technology
Department of Mathematics
CIENCIA 2016
July 04-06, 2016
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 1 / 18
Outline
Research Projects
Image Processing - Medical Images
Lesion Detectors in Retinal Images
Polyp Detector in WCE Images - ColonBleeding Detection in WCE Images - Small BowelQualitative information about the WCE speed
(WCE=Wireless Capsule Endoscopy)
Mathematical Models and SimulationsColon cancer (prediction of the evolution of the disease)
Colonic Crypt MorphogenesisParameter Estimation Problems
Conclusions (ongoing work)
Publications
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 2 / 18
Research Projects
FCT Research Projects (Funding)
Aberrant Crypt Foci and Human Colorectal Polyps:mathematical modelling and endoscopic image processing.
UTAustin/MAT/0009/2008 (4 years : 2009-2013).
Advances in Image Processing and Inverse Problems: Applications inMedical and Earth Observation Imagery, and Biomathematics.
PTDC/MAT-NAN/0593/2012 (2 years : 2013-2015).
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 3 / 18
Research Projects
Research Projects with Industry (ongoing)
Image processing in ophthalmology for diabetic patients:a new technology (2013-2016).Company : Retmarker (http://www.retmarker.com/)a spin-off of Critical Software.
Automated Screening System for Diabetic Retinopathy(commercialization phase).
Smartphone Applications:Emergency Signal Detection and Fall Detection (2015-2017).Company : OnCaring (http://oncaring.com/)a spin-off of Critical Software.
(commercialization phase - very soon)
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 4 / 18
Retinal Images - Microaneurysms
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 5 / 18
Retinal Images - Hemorrhages and Bright Lesions
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 6 / 18
Wireless Capsule Endoscopy (WCE)
(a) (b)
Figure: (a) Capsules ; (b) Interior of a capsule.
Patients swallow a very small capsule (with the size and shape of avitamin pill) consisting of
a miniature video cameraa light sourcebatteriesa radio transmitter
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 7 / 18
Polyp Detector in WCE sequences (Colon)
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 8 / 18
Bleeding Detection in WCE images (small bowel - SB)
−10
0
10
20
30
0
50
100
150
0
50
100
150
200
250
0
10
20
30
0
50
100
150
200
0
50
100
150
200
250
0
5
10
15
20
25
30
35
0
50
100
150
0
50
100
150
(a) (b) (c) (d)
Figure: (a) SB PillCam frames with bleeding regions. (b) Channel I a. (c)Generalized structure tensor Sa . (d) Bleeding regions detected.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 9 / 18
WCE - SB frames (Mucosa Segmentation)
Figure: Left to right : Original image, segmentation mask and segmentationcurve over the original image.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 10 / 18
Indicator of the WCE speed - WCE Location
10 20 30 40 50 60 70 80 90
0.1
0.15
0.2
0.25
0.3
0.35
Figure: WCE video clip of SB PillCam, with the duration of 20 seconds and 100frames, represented by the similarity curve between the consecutive frames. Leftpair - frames 12 and 13 and the point in the curve is (12, 0.05523). Right pair -frames 51 and 52, and the point in the curve is (51, 0.37815).
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 11 / 18
Aberrant Crypt Foci - Bifurcation of a colonic crypt
(a) (b) (c) (d)
Figure: Comparison of a medical image with the numerical simulations. (a)Medical image exhibiting a bifurcated colonic crypt. (b) Finite element mesh. (c)Proliferative cell density N. (d) Pressure p.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 12 / 18
Ex. I - Chromoscopy based Parameter Estimation
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Figure: Medical image with 5602 pixels, N = 200. Segmentation, the optimal dyeconcentration and optimal adjoint dye concentration at final time.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 13 / 18
Ex. II - Chromoscopy based Parameter Estimation
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Figure: Medical image with 2002 pixels, N = 200. Segmentation, the optimal dyeconcentration and optimal adjoint dye concentration at final time.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 14 / 18
Conclusions (ongoing and future work)
Image Processing
Medical Images
Endoscopic images (gastroenterology)
Ophthalmologic images
Earth Observation Images (Radar and Optical Satellite images)
Main goal - Computer-Aided Decision Support Systems
Collaboration with Industry (societal impact)
Bio-Mathematics
Colon Cancer related problems
Main goal - Colon cancer appearance and dynamics by using in silicomodels (for understanding and prediction).
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 15 / 18
Publications (Image Processing)
A. V. Mamonov, I. N. Figueiredo, P. N. Figueiredo, R. Tsai:Automated Polyp Detection in Colon Capsule Endoscopy,IEEE Transactions on Medical Imaging, 2014.
P. N. Figueiredo, I. N. Figueiredo, S. Prasath and R. Tsai :Automatic Polyp Detection in PillCam COLON 2 CapsuleImages and Videos - Preliminary Feasibility Report,Diagnostic and Therapeutic Endoscopy, 2011.
I. Figueiredo, S. Kumar, C. Leal, P. Figueiredo: Computer-assistedbleeding detection in wireless capsule endoscopy images,Computer Methods in Biomechanics and BiomedicalEngineering: Imaging & Visualization, 2013.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 16 / 18
Publications (Image Processing)
I. N. Figueiredo, C. Leal, L. Pinto, P. N. Figueiredo, R. Tsai:An Elastic Image Registration Approach for Wireless CapsuleEndoscope Localization.(submitted in 2015)
I. Figueiredo, P. Figueiredo, G. Stadler, O. Ghattas and A. Araujo :Variational image segmentation for endoscopic human colonicaberrant crypt foci,IEEE Transactions on Medical Imaging, 2010.
I. N. Figueiredo, S.Kumar, C.M. Oliveira, J.D.Ramos, B.Engquist:Automated lesion detectors in retinal fundus images.Computers in Biology and Medicine, 2015.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 17 / 18
Publications (Bio-Mathematics)
I. N. Figueiredo, G. Romanazzi, C. Leal, B. Engquist:An Homogenization Model for Aberrant Crypt Foci,SIAM Journal on Applied Mathematics, 2016.
I. N. Figueiredo, C. Leal, G. Romanazzi, B. Engquist, P. N.Figueiredo: A Convection-Diffusion-Shape Model for AberrantColonic Crypt Morphogenesis,Computing and Visualization in Science, 2011.
I. N. Figueiredo, C. Leal: Physiologic Parameter Estimation usingInverse Problems,SIAM Journal on Applied Mathematics, 2013.
I. N. Figueiredo, P. Figueiredo, N. Almeida: Image-drivenparameter estimation in absorption-diffusion models ofchromoscopy, SIAM Journal on Imaging Sciences, 2011.
(CIENCIA 2016) Image Processing, Simulation and Cancer July 04-06, 2016 18 / 18
