51
1 Digital Image Processing Lecture # 6 Sharpening Filters & Edge Detection

Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

  • Upload
    others

  • View
    13

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

1

Digital Image Processing

Lecture # 6Sharpening Filters & Edge Detection

Page 2: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Sharpening Spatial Filters

Previously we have looked at smoothing filters which remove

fine detail

Sharpening spatial filters seek to highlight fine detail

Remove blurring from images

Highlight edges

Sharpening filters are based on spatial differentiation

Page 3: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Spatial Differentiation

• Let’s consider a simple 1 dimensional

example

Page 4: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Spatial Differentiation

A B

Page 5: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

1st Derivative

The 1st derivative of a function is given by:

Its just the difference between subsequent

values and measures the rate of change of

the function

)()1( xfxfx

f

Page 6: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Image Strip

0

1

2

3

4

5

6

7

8

1st Derivative

-8

-6

-4

-2

0

2

4

6

8

5 5 4 3 2 1 0 0 0 6 0 0 0 0 1 3 1 0 0 0 0 7 7 7 7

-1 -1 -1 -1 -1 0 0 6 -6 0 0 0 1 2 -2 -1 0 0 0 7 0 0 0

1st Derivative

Page 7: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

2nd Derivative

The 2nd derivative of a function is given by:

Simply takes into account the values both before and after the current value

)(2)1()1(2

2

xfxfxfx

f

Page 8: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Image Strip

0

1

2

3

4

5

6

7

8

5 5 4 3 2 1 0 0 0 6 0 0 0 0 1 3 1 0 0 0 0 7 7 7 7

2nd Derivative

2nd Derivative

-15

-10

-5

0

5

10

-1 0 0 0 0 1 0 6 -12 6 0 0 1 1 -4 1 1 0 0 7 -7 0 0

Page 9: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 10: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

2nd Derivative for Image Enhancement

The 2nd derivative is more useful for image enhancement

than the 1st derivative - Stronger response to fine detail

We will come back to the 1st order derivative later on

The first sharpening filter we will look at is the Laplacian

Page 11: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Filter

2

2

2

22

y

f

x

ff

),(2),1(),1(2

2

yxfyxfyxfx

f

The Laplacian is defined as follows:

),(2)1,()1,(2

2

yxfyxfyxfy

f

Page 12: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Filter

So, the Laplacian can be given as follows:

),1(),1([2 yxfyxff

)]1,()1,( yxfyxf

),(4 yxf

0 1 0

1 -4 1

0 1 0

Can we implement it using a filter/ mask?

Page 13: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Filter

Page 14: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Filter

Applying the Laplacian to an image we get a

new image that highlights edges and other

discontinuities

Original

Image

Laplacian

Filtered Image

Laplacian

Filtered Image

Scaled for Display

Page 15: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Image Enhancement

The result of a Laplacian filtering is not an

enhanced image

Laplacian

Filtered Image

Scaled for Display2

5

2

5

( , ) , 0( , )

( , ) , 0

f x y f wg x y

f x y f w

To generate the final enhanced image

Page 16: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Image Enhancement

In the final sharpened image edges and fine

detail are much more obvious

- =

Original

Image

Laplacian

Filtered Image

Sharpened

Image

Page 17: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian Image Enhancement

Page 18: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Simplified Image Enhancement

• The entire enhancement can be combined

into a single filtering operation

),1(),1([),( yxfyxfyxf

)1,()1,( yxfyxf

)],(4 yxf

fyxfyxg 2),(),(

Page 19: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Simplified Image Enhancement

• The entire enhancement can be combined

into a single filtering operation

fyxfyxg 2),(),(

),1(),1(),(5 yxfyxfyxf

)1,()1,( yxfyxf0 -1 0

-1 5 -1

0 -1 0

Page 20: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Simplified Image Enhancement

• This gives us a new filter which does the

whole job for us in one step

0 -1 0

-1 5 -1

0 -1 0

Page 21: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Unsharp Masking

Page 22: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 23: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Use of first derivatives for image enhancement: The Gradient

• The gradient of a function f(x,y) is defined as

y

fx

f

G

G

y

xf

Page 24: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

-1 -2 -1

0 0 0

1 2 1

-1 0 1

-2 0 2

-1 0 1

Extract horizontal edges

7 8 9 1 2 3

3 6 9 1 4 7

( 2 ) ( 2 )

( 2 ) ( 2 )

f z z z z z z

z z z z z z

Emphasize more the current point

(y direction)

Emphasize more the current point (x

direction) Pixel Arrangement

Gradient Operators

Extract vertical edges

Sobel Operator

Page 25: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Sobel Operator: Example

Sobel filters are typically used for edge

detection

An image of a

contact lens

which is

enhanced in

order to make

defects more

obvious

Page 26: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Combining Spatial Enhancement Methods

Successful image enhancement is

typically not achieved using a single

operation

Rather we combine a range of

techniques in order to achieve a final

result

This example will focus on enhancing

the bone scan

Page 27: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 28: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 29: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Combining Spatial Enhancement Methods

Compare the original and final images

Page 30: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edge Detection

• Edge detectors can be based on the first and secondderivatives which can detect abrupt intensity changes.

• Derivates of digital functions are defined in terms ofdifferences

• See approximations on using first and second derivativesin Gonzalez section 10.2.1

30

Page 31: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 32: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edge Detection

• First order derivatives produce thick edges while second orderderivatives produce finer ones. See ramp edge on the figure10.2 on previous slide

• Second order derivatives enhance sharp changes and finedetails more aggressively than first order derivatives see theisolated point and the line in the same figure. This can be aproblem if the noise is present in the image

• Second derivative changes its sign as it transitions into andout of a ramp or step edge. See the step edge. This “doubleedge” effect can be used to locate edges.

• The sign of the second derivative is also used to determinewhether an edge is a transition from light to dark (-ve value)or from dark to light (+ve value). See step edge

32

Page 33: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edge Detection

33

Page 34: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edges

Page 35: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 36: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edge Detection

• First and second derivativefor smooth noiseless edge• The zero crossings of the

second derivative can be used for locating edges in an image.

36

Page 37: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edge Detection

Results of first and second derivative for edges with Gaussian noise of mean = 0.

0.0

1.0

0.1

0.10

First derivative

Second derivative

•Smoothing step is a must before taking derivative for edge detection

37

Page 38: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Gradient Operators• Most common differentiation operator is the

gradient vector.

Magnitude:

Direction:

y

x

G

G

y

yxf

x

yxf

yxf),(

),(

),(

xxyx GGGGyxf 2/122

),(

x

y

G

Gyxf 1tan),(

38

Page 39: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Gradient Operators

Some common gradient operators

Roberts and Prewitt masks are the simplest but not robust against noise

Sobel edge detection masks are the most common and give satisfactory results in presence of noise

39

Page 40: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Gradient Operators

Page 41: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

•The direction of an edge at a point is orthogonal to the direction of thegradient vector at the point

Direction of an Edge

Page 42: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 43: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 44: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 45: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 46: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian of a Gaussian (LoG)

• A filter which combines the smoothing function (Gaussian) with the Laplacian is called Laplacianof a Gaussian (LoG) filter.

• Robust against noise.

• Consider a smoothing Gaussian function:

where r2 = x2 + y2, : standard deviation

• The Laplacian of this function gives the LoGfunction:

2

2

2)(

r

erG

2

2

24

22

2

22 2)(

)(

r

er

r

rGrG

46

Page 47: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Laplacian of a Gaussian (LoG) Filter

47

Page 48: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Edge detection by LoG

• Due the shape of this function it is also calledMexican hat function (or Mexican hat filters).

• Better performance against noise. Reduces theintensity of structures or noise, which are at scalesmuch smaller than sigma.

• Choose size of Gaussian mask to be n >= 6*sigma

• Then use a 3x3 Laplacian

• Find the zero crossings

48

Page 49: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail
Page 50: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

Readings from Book (3rd Edn.)

• Sharpening Filters (Chapter – 3)• Edge Detection (Chapter – 10)

Reading Assignment • High Boost Filtering (Chap – 3)• Laplacian of Gaussian (LoG) (Chap –

10)

Page 51: Lecture # 6 Sharpening Filters & Edge Detectionbiomisa.org/uploads/2014/03/Lect-6.pdfSharpening Spatial Filters Previously we have looked at smoothing filters which remove fine detail

51

Acknowledgements

Digital Image Processing”, Rafael C. Gonzalez & Richard E. Woods, Addison-Wesley, 2002

Computer Vision for Computer Graphics, Mark Borg

Mat

eria

l in

th

ese

slid

es h

as b

een

tak

en f

rom

, th

e fo

llow

ing

reso

urc

es