44
Part I: Image Transforms DIGITAL IMAGE PROCESSING

Part I: Image Transforms DIGITAL IMAGE PROCESSING

Embed Size (px)

Citation preview

Page 1: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Part I: Image Transforms

DIGITAL IMAGE PROCESSING

Page 2: Part I: Image Transforms DIGITAL IMAGE PROCESSING

}10 ),({ Nxxf

1

0)(),()(

N

xxfxuTug

1-D SIGNAL TRANSFORMGENERAL FORM

10 Nu

fTg

• Scalar form

• Matrix form

Page 3: Part I: Image Transforms DIGITAL IMAGE PROCESSING

}10 ),({ Nxxf

1

0)(),()(

N

xxfxuTug

1-D SIGNAL TRANSFORM cont.REMEMBER THE 1-D DFT!!!

• General form

10 Nu

1

0

2

)(1

)(N

x

N

xuj

xfeN

ug

• DFT

Page 4: Part I: Image Transforms DIGITAL IMAGE PROCESSING

1-D INVERSE SIGNAL TRANSFORMGENERAL FORM

• Scalar form

1

0)(),()(

N

uuguxIxf

• Matrix form

gTf 1

Page 5: Part I: Image Transforms DIGITAL IMAGE PROCESSING

}10 ),({ Nxxf

1-D INVERSE SIGNAL TRANSFORM cont.REMEMBER THE 1-D DFT!!!

• General form

1

0

2

)()(N

x

N

xuj

ugexf

10 Nu

• DFT

1

0)(),()(

N

uuguxIxf

Page 6: Part I: Image Transforms DIGITAL IMAGE PROCESSING

1-D UNITARY TRANSFORM

fTg

• Matrix form

TTT 1

Page 7: Part I: Image Transforms DIGITAL IMAGE PROCESSING

SIGNAL RECONSTRUCTION

1

0)(),()(

N

u

TugxuTxfgTf

TTT 1

Page 8: Part I: Image Transforms DIGITAL IMAGE PROCESSING

IMAGE TRANSFORMS

• Many times, image processing tasks are best performed in a domain other than the spatial domain.

• Key steps:

(1) Transform the image

(2) Carry the task(s) in the transformed domain.

(3) Apply inverse transform to return to the spatial domain.

Page 9: Part I: Image Transforms DIGITAL IMAGE PROCESSING

2-D (IMAGE) TRANSFORMGENERAL FORM

1

0

1

0),(),,,(),(

N

x

N

yyxfyxvuTvug

1

0

1

0),(),,,(),(

N

u

N

vvugvuyxIyxf

Page 10: Part I: Image Transforms DIGITAL IMAGE PROCESSING

2-D IMAGE TRANSFORMSPECIFIC FORMS

• Separable

• Symmetric

),(),(),,,( 21 yvTxuTyxvuT

),(),(),,,( 11 yvTxuTyxvuT

Page 11: Part I: Image Transforms DIGITAL IMAGE PROCESSING

• Separable and Symmetric

• Separable, Symmetric and Unitary

TTfTg 11

11 TgTfT

Page 12: Part I: Image Transforms DIGITAL IMAGE PROCESSING

ENERGY PRESERVATION

• 1-D

• 2-D

1

0

1

0

21

0

1

0

2),(),(

M

u

N

v

M

x

N

yvugyxf

22fg

Page 13: Part I: Image Transforms DIGITAL IMAGE PROCESSING

ENERGY COMPACTION

Most of the energy of the original data concentrated in only a few of the significant transform coefficients; remaining coefficients are near zero.

Page 14: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Why is Fourier Transform Useful?

• Easier to remove undesirable frequencies.

• Faster to perform certain operations in the frequency domain than in the spatial domain.

• The transform is independent of the signal.

Page 15: Part I: Image Transforms DIGITAL IMAGE PROCESSING

ExampleRemoving undesirable frequencies

remove highfrequencies

reconstructedsignal

frequenciesnoisy signal

zero! to tscoeeficien

ingcorrespond

their set s,frequencie

certain remove To

)(uF

Page 16: Part I: Image Transforms DIGITAL IMAGE PROCESSING

How do frequencies show up in an image?

• Low frequencies correspond to slowly varying information (e.g., continuous surface).

• High frequencies correspond to quickly varying information (e.g., edges)

Original Image Low-passed

Page 17: Part I: Image Transforms DIGITAL IMAGE PROCESSING

2-D DISCRETE FOURIER TRANSFORM

1

0

1

0

)//(2),(),(M

x

N

y

NvyMuxjeyxfvuF

1

0

1

0

)//(2),(1

),(M

u

N

v

NvyMuxjevuFMN

yxf

Page 18: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Visualizing DFT

• Typically, we visualize

• The dynamic range of is typically very large

• Apply stretching:

( is constant)

before scaling after scalingoriginal image

),( vuF),( vuF

]),(1log[),( vuFcvuD c

Page 19: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Amplitude and Log of the Amplitude

Page 20: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Amplitude and Log of the Amplitude

Page 21: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Original and Amplitude

Page 22: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Rewrite as follows:

If we set:

Then:

1

0

/2

1

0

/2

1

0

1

0

/2/2

),(),(

),(),(

),(),(

M

x

Muxj

N

y

Nvyj

M

x

N

y

NvyjMuxj

vxGevuF

eyxfvxG

eyxfevuF

DFT PROPERTIES: SEPARABILITY

),( vuF

Page 23: Part I: Image Transforms DIGITAL IMAGE PROCESSING

• How can we compute ?

• How can we compute ?

).( of rows of DFT

),(1

),(),(

1

0

/2

1

0

/2

yxfN

eyxfN

N

eyxfvxG

N

y

Nvyj

N

y

Nvyj

DFT PROPERTIES: SEPARABILITY),( vxG

),( vuF

),( of columns of DFT

),(1

),(1

0

/2

vxGM

evxGM

MvuFM

x

Muxj

Page 24: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: SEPARABILITY

Page 25: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: PERIODICITY

The DFT and its inverse are periodic with period N

),(),(

),(),(

NvMuFNvuF

vMuFvuF

Page 26: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: SYMMETRY

If is real, then),( vuF

odd andimaginary odd and real

even and real even and real

),(),(

),(),(

),(),(),(),( *

vuFyxf

vuFyxf

vuFvuFvuFvuF

Page 27: Part I: Image Transforms DIGITAL IMAGE PROCESSING

• Translation in spatial domain:

• Translation in frequency domain:

DFT PROPERTIES: TRANSLATION

),(),( 00)//(2 00 vvuuFeyxf NyvMxuj

)//(200

00),(),( NyvMxujevuFyyxxf

Page 28: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Warning: to show a full period, we need to translate the origin of the transform at

DFT PROPERTIES: TRANSLATION

2/Nu )2/,2/(),( NMvu

)(uF

)2

(N

uF

Page 29: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: TRANSLATION

)2/,2/()1)(,(

),(),(

)1(

2/2/

)2/,2/(),(

)(

00)//(2

)()()//(2

00

00

00

nvMuFyxf

vvuuFeyxf

ee

NvMu

NMvuF

yx

NyvMxuj

yxyxjNyvMxuj

Using

case that In

and take

at move To

Page 30: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: TRANSLATION

no translation after translation

)2/,2/()1)(,( )( nvMuFyxf yx

Page 31: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: ROTATION

by rotates by rotating ),,(),( vuFyxf

Page 32: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIESADDITION-MULTIPLICATION

transform Fourier the is ][ where

)],([)],([)],(),([

)],([)],([)],(),([

yxgyxfyxgyxf

yxgyxfyxgyxf

Page 33: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: SCALE

transform Fourier the is ][ where

)],([)],([)],(),([

)],([)],([)],(),([

yxgyxfyxgyxf

yxgyxfyxgyxf

Page 34: Part I: Image Transforms DIGITAL IMAGE PROCESSING

DFT PROPERTIES: AVERAGE

)0,0(1

),(

),()0,0(

),(1

),(

1

0

1

0

1

0

1

0

FMN

yxf

yxfF

yxfMN

yxf

M

x

N

y

M

x

N

y

:image the of value Average

Page 35: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Original Image Fourier Amplitude Fourier Phase

Page 36: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Magnitude and Phase of DFT

• What is more important?

• Hint: use inverse DFT to reconstruct the image using magnitude or phase only information

magnitude phase

Page 37: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Magnitude and Phase of DFT

Reconstructed image using

magnitude only

(i.e., magnitude determines the

contribution of each component!)

Reconstructed image using

phase only

(i.e., phase determines

which components are present!)

Page 38: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Magnitude and Phase of DFT

Page 39: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Original Image-Fourier AmplitudeKeep Part of the Amplitude Around the Origin and Reconstruct Original

Image (LOW PASS filtering)

Page 40: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Keep Part of the Amplitude Far from the Origin and Reconstruct Original Image (HIGH PASS filtering)

Page 41: Part I: Image Transforms DIGITAL IMAGE PROCESSING
Page 42: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Reconstruction from

phase of one image and amplitude of the other

Page 43: Part I: Image Transforms DIGITAL IMAGE PROCESSING
Page 44: Part I: Image Transforms DIGITAL IMAGE PROCESSING

Reconstruction from

phase of one image and amplitude of the other