66
Image analysis Daniel Smutek

Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Image analysis

Daniel Smutek

Page 2: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 3: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Biological imaging

• Radiology (clinical imaging)

• Endoscopy

• Microscopy

• Maps from biomedical signals

– electroencephalography (EEG)

– magnetoencephalography (MEG)

Page 4: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Clinical/Medical Imaging

• X-ray (Projection radiography)

-contrast, double contrast

• Computed tomography (CT)

• Ultrasound

• Magnetic resonance imaging (MRI)

• Nuclear medicine

– Positron emission tomography (PET)

Page 5: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Invasive/Non-invasive

• X-ray

• CT

• Nuclear Imaging

• Ultrasound

• MRI

vs contrast agents(gadolinium-based, microbubbles)

radiation exposure, adverse

reactions to contrast agents

(barium sulfate vs iodine agents)

Page 6: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Radiation exposure

ExaminationRelative

dose

Chest X-ray 1

Head CT 75

Abdomen CT 265

Chest CT 290

Chest, Abdomen and Pelvis CT 495

Cardiac CT angiogram 500

CT colonography (virtual colonoscopy) 250

Page 7: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

7

Digitalization:

• Sampling – Aividing the image in pixels. Sampling gives us resolution of a digital image (e.g. in megapixels –Mpx). It is necessary to choose an appropriate resolution to preserve all the information that we want to capture

• Quantization - Assigning a numerical value to every pixel. The value represents color (brightness) of the pixel. E.g. 8-bit quantization offers 28 = 256 numerical values for each pixel

• Binary reprezentation – coding the image in bites for writing into a data file

Page 8: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Resolution – given by samling256x256 pixels 128x128 pixels 64x64 pixels

32x32 pixels 16x16 pixels 8x8 pixels

Page 9: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

No. shades of grey – given by quantization

256 shades 16 shades

8 shades 4 shades 2 shades - black and white only

Page 10: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Noise

Page 11: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

11

Brightness and contrast

• The brightness value is assigned to each pixel – Grayscale images – typically 1 byte for each px

which can represent 256 shades of gray

– Color images • Three channls – Red, Green, Blue

• Every chanell has its own range of values

• E.g. TrueColor images – 1 byte (256 values) for Red channel, 1 byte (256 values) for Green channel, 1 byte (256 values) for Blue channel. In total 3 bytes = 24 bites, therefore Truecolor images provides 224 or 16,777,216 color variation

• Contrast - define as a brightness difference between two pixels

Page 12: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Image histogram• Graphical representation showing amount of pixels in the

image for each brightness value

• Useful when we want to determine if the image is too

dark (underexposed) or too bright (overexposed) or if it

has a small dynamic range (low overall contrast)

Page 13: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Native image

Page 14: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Decrease of

brightness

Page 15: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Increase of

brightness

Page 16: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

16

Změna jasuZvýšení jasu → přičtení konstanty >0

Page 17: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

17

Změna jasuSnížení jasu → odečtení konstanty >0

Page 18: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Native image

Page 19: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Decrease of

contrast

Page 20: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Increase of

contrast

Page 21: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

21

Změna kontrastuZvýšení kontrastu → násobení konstantou >1

Page 22: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

22

Změna kontrastuSnížení kontrastu → dělení konstantou >1

Page 23: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

23

Histogram Equalization - CT image

intelligent histogram adjustment that gives much

better contrast

Native image After equalization

Page 24: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Diagnosis

Computer Aided Diagnosis

(CAD)

Page 25: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Thyroid and its Function

Hyperfunction - orbitopathy

Hypofunction - cretenism

Page 26: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 27: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

2D histogram – co-occurrence matrix

obraz – grey levels

kookurenční matice

(2D histogram) pro (1;0)

1D histogram

Page 28: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Haralick Texture Features for

2D Image Segmentation

co-occurrence matrix : normalization :

Haralick features :

We used 15 texture features:• entropy• texture contrast• texture correlation• texture homogeneity• inverse difference moment• ...

e.g. texture homogeneity :

Page 29: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 30: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

DSA – digital subtraction angiography

-Subtraction

Contrast

adjustment

maskAfter injection

of contrast

medium

Page 31: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 32: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

32

Page 33: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Segmentation of CT 3D

Images in Medicine

• diagnosing

• organs segmentation

• Future-CAD project

Page 34: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Texture-based segmentation

of 3D Images

• 2D texture image segmentation well established

• 3D texture segmentation can use more information

Page 35: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Example – Results of Segmentation

• original image

• hand-made segmentation

• automatic segmentation using our method

Page 36: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

36

Page 37: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

39

Page 38: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

40

Page 39: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

41

Page 40: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

42

Page 41: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

43

Page 42: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

PACS

• Picture archiving and communication

system

• computers or networks dedicated to the

storage, retrieval, distribution and

presentation of images

• integration with

– hospital information system

– radiology information system (RIS).

Page 43: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

DICOM

• Digital Imaging and Communications in Medicine

• Standard for medical imaging– handling

– storing

– printing

– transmitting

• file format definition

• network communications protocol (TCP/IP based)

Page 44: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

DICOM format (Digital Imaging and

Communications in Medicine) - header

Image Type (0008,0008) 1-n CS [ORIGINAL\PRIMARY\M\NORM]

Study Date (0008,0020) 1 DA [2005.01.24]

Study Time (0008,0030) 1 TM [18:03:49.859000]

Modality (0008,0060) 1 CS [UZ]

Patient's Name (0010,0010) 1 PN [xxx]

Patient's ID (0010,0020) 1 LO [RC]

Slice Thickness (0018,0050) 1 DS [6]

Trigger Time (0018,1060) 1 DS [242.5]

Series Number (0020,0011) 1 IS [9]

Acquisition Number (0020,0012) 1 IS [1]

Instance (form...Image) Number (0020,0013) 1 IS [8]

Image Position (Patient) (0020,0032) 3 DS [-17.569595\-171.59116\114.26955]

Image Orientation (Patient) (0020,0037) 6 DS [0.77845185\0.62770433\-4.0211107e-009\-0.35008808\0.43416414\-0.830024]

Slice Location (0020,1041) 1 DS [-37.985614]

Rows (0028,0010) 1 US [256]

Columns (0028,0011) 1 US [192]

Pixel Spacing (0028,0030) 2 DS [1.40625\1.40625]

Bits Allocated (0028,0100) 1 US [16]

Bits Stored (0028,0101) 1 US [12]

High Bit (0028,0102) 1 US [11]

Pixel Data (7FE0,0010) 1 OW [49152 * 2 bytes at offset 23518]

Page 45: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 46: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 47: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 48: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 49: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 50: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 51: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 52: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 53: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 54: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 55: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 56: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 57: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 58: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 59: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 60: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 61: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 62: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 63: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Registration

Page 64: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication
Page 65: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

Fin

d 9

heads

Page 66: Daniel Smutek - Univerzita Karlova · 2020. 9. 7. · better contrast Native image After equalization. Diagnosis Computer Aided Diagnosis (CAD) ... • Picture archiving and communication

79

Literature

• Špunda, Dušek & kol.: Zdravotnická informatika, Karolinum, Praha, 2007

• Kasal, Svačina: Lékařská informatika (Karolinum, Praha, 1998)

• Nekula & kol.: Radiologie, 3. vyd. (Univerzita Palackého, Olomouc, 2005)

• Urbánek: Nukleární medicína, 4. vyd. (Gentiana, Jilemnice, 2002)

• Huang: PACS and Imaging Informatics – Basic Principles and Applications, 1st edition (Wiley, New Jersey, 2004)

• Shortliffe, Cimino: Biomedical Informatics – Computer Applications in Health Care and Biomedicine, 3rd edition(Springer, New York, USA, 2006)

• Poznámky a prezentace z přednášek a seminářů, e-learningové materiály ze stránek ústavů 1. LF UK /2002 -2009/ (biofyzika, fyziologie, nukleární medicína, radiologie)