Content Based Image Retrieval (CBIR) of Dermatological Images

H.H.W.J Bosman, N. Petkov, M.F. Jonkman

Image retrieval: http://images.google.nl

Image retrieval: http://images.google.nl

CBIR - what is it? Search for images that are similar to an input

image Features that might indicate similarity

Color Texture Shape Text tags etc...

iMedia Project – select queryhttp://www-rocq.inria.fr/cgi-bin/imedia/circario.cgi/v2std

iMedia Project – query resultshttp://www-rocq.inria.fr/cgi-bin/imedia/circario.cgi/v2std

GIFT – select queryhttp://viper.unige.ch/demo/php/demo.php

GIFT – query resulthttp://viper.unige.ch/demo/php/demo.php

Leiden 19th-Century Portrait Databasehttp://nies.liacs.nl:1860/cgi-bin/FindImage.pl

Leiden 19th-Century Portrait Databasehttp://nies.liacs.nl:1860/cgi-bin/FindImage.pl

CBIR in medical settings

Seeking pathologically similar mammogram imagesDept of Computer Science at Warwick university

http://www2.warwick.ac.uk/fac/sci/dcs/research/mimic/projects/lisprojectpage

CBIR in medical settingshttp://cobweb.ecn.purdue.edu/~cbirdev/WEB_ASSERT/assert.html

CBIR in dermatology

CBIR in dermatology

Methods - the dataset 211 dermatological images from the UMCG

image database Divided into 4 classes: Red, White, Blue,

Brown

Manually selecting area of healthy skin (70,110,90) and lesion skin (120,95,80)

CBIR in dermatology

CBIR in dermatology

CBIR in dermatology

Results with only color features 75% correct retrieval

White is retrieved best Blue is the most difficult to retrieve

Results vary with the ‘goodness’ of the selection of different regions.

From CBIR to CBCR (content based case retrieval)

TEST CASE defined byPROVOKE query:

Plaats: ... Efflorescentie: ...Rangschikking: ...Omvang: ...Kleur/Vorm/Omtrek:

Questions or suggestions?