29
IEEE Transaction on Image Processing vol. PP, No. 99, 2012 Shi-Chia Huang, Fan-Chieh Cheng, and Yi-Sheng Chiu Presented by Shu Ran School of Electrical Engineering and Computer Science Kyungpook National Univ. Efficient contrast enhancement using adaptive gamma correction with weighting distribution

Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

IEEE Transaction on Image Processing

vol. PP, No. 99, 2012

Shi-Chia Huang, Fan-Chieh Cheng, and Yi-Sheng Chiu

Presented by Shu Ran

School of Electrical Engineering and Computer Science

Kyungpook National Univ.

Efficient contrast enhancement using

adaptive gamma correction with

weighting distribution

Page 2: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Abstract

Proposed method

– Automatic modifying histogram and enhancing contrast

– Improving brightness of dimmed images

• Gamma correction

• Probability distribution of luminance pixels

– Enhancing video

• Using temporal information

− Regarding differences between each frame

» Reducing computational complexity

2/29

Page 3: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Introduction

Concept of contrast enhancement

– Improving visual quality

• Computer vision and pattern recognition and image processing

– Circumstance resulting poor contrast

• Lack of operator expertise

• Inadequacy of image capture device

• Environmental conditions in captured scene

− Obscuring details of image or video feature

– Two categories of contrast enhancement

• Direct enhancement

− Directly defining contrast by specific contrast term

» Cannot simultaneously gauging contrast of simple and complex

patterns

3/29

Page 4: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Indirect enhancement

− Redistributing probability density

» Histogram modifications techniques

Gamma correction techniques

– Using varying adaptive parameter

• Simple form of transform-based gamma correction

− Different images exhibiting same changes in intensity

» Using probability density function

max max/T l l l l

(1)

maxlwhere is the maximum intensity of the input

/lpdf l n MN (2)

where is the number of pixels that have intensity ,

and is the total number of pixels in the image ln l

MN

4/29

Page 5: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

» Cumulative distribution function

• Traditional histogram equalization

− Using cdf as transformation curve

• Transformation curves

0

l

k

cdf l pdf k

(3)

maxT l cdf l l (4)

Fig. 1. Transformation curves illustrated by (a) gamma

correction and (b) THE methods, with their corresponding

intensity level modifications shown in (c) and (d). 5/29

Page 6: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Previous works

Approaches of THE and TGC methods

– Earlier works in sub-histograms as 1D histogram

• BBHE calculating mean intensity as threshold value

• DSIHE using median intensity

− RSIHE using multi-equalizations reducing artifacts

− RSWHE using weighting function to smooth sub-histogram

» Losing some statistical information

• BPHEME maximizing entropy of enhanced image via histogram

speciation

– 2D histogram for generating contextual and variational information

• Gaussian mixture model

− Compensating for gray-level distribution of image

• Contextual and variational contrast

− Constructing priori probability

6/29

Page 7: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Proposed method

Proposing hybrid HM method

– Compensating limitations of previous methods

– Creating balance

• Between high levels of visual quality and low computational costs

− Utilizing efficiently combining TGC and THE methods

– Proposing cdf and applied normalized gamma function

• Modifying transformation curve

− Without losing available histogram of statistics

• Proposed adaptive gamma correction

− Increasing low intensity

− Avoiding significant decrement of high intensity

1

max max max max/ /cdf l

T l l l l l l l

(5)

7/29

Page 8: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Applying weighting distribution function

− Slightly modifying statistical histogram

− Lessen generation of adverse effects

− Modified cdf function

− Sum of

min

max

max min

w

pdf l pdfpdf l pdf

pdf pdf

(6)

where is the adjusted parameter,

is the maximum pdf of statistical histogram,

and is minimum pdf

maxpdf

minpdf

max

0

/l

w w w

k

cdf l pdf l pdf

(7)

wpdf

max

0

l

w w

l

pdf pdf l

(8)

8/29

Page 9: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

− Gamma parameter based on cdf

– Using HSV color model for enhancing only luminance intensity

• By proposed AGC and WD method

• Flow chart of AGCWD method

(9) 1w

cdf l

Fig. 2. The flowchart of the AGCWD method.

9/29

Page 10: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Proposing temporal-based technique

• Reducing computational complexity for video sequence

Fig. 3. The flowchart of the TB method applied to a video sequence.

10/29

Page 11: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Approximating information content of each frame

max

0

logl

l

H pdf l pdf l

(10)

11/29

Page 12: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Experimental results

Summarizing experimental results

– Image-contrast enhancement

• Enhancing various grayscale and color images

− Following same decomposition of histogram used by previous

– Considering illumination conditions

• Indoor and outdoor scenes

12/29

Page 13: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Visual assessment

– Performance of each method

• Measured by four grayscale images

Fig. 4. The “blackboard” image: (a) is the original image with its

corresponding statistical histogram; the remaining nine images are

the enhancement results with modified histograms generated by the

(b) THE, (c) BBHE, (d) DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC,

(h) AWMHE, (i) CVC, and (j) AGCWD methods. 13/29

Page 14: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Grayscale image of truck

Fig. 5. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods. 14/29

Page 15: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Grayscale image of viaduct

Fig. 6. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods. 15/29

Page 16: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Grayscale image of warplane

Fig. 7. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods. 16/29

Page 17: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Visual assessment for color image

• Color image of man

Fig. 8. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods.

17/29

Page 18: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Color image of square

Fig. 9. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods.

18/29

Page 19: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Color image of sky

Fig. 10. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods.

19/29

Page 20: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Color image of road

Fig. 11. (a) is the original image with its corresponding statistical

histogram; the remaining nine images are the enhancement results

with modified histograms generated by the (b) THE, (c) BBHE, (d)

DSIHE, (e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC,

and (j) AGCWD methods.

20/29

Page 21: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Quantitative evaluation

– Classifying objective metrics

• Full-reference and no-reference and reduced-reference

– Focusing on FR method

• Highlighting use of distortion-free image

− As reference image for assessment

– Snapshots of environment and devices

• Consumer camera and ColorChecker

• Illumination meter to perform quantitative evaluation

− In specific dark room

Fig. 12. Snapshots of environments and devices.

21/29

Page 22: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Color information of blocks in ColorChecker

Table 1. The standard RGB(sRGB) values of ColorChecker

22/29

Page 23: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Capturing images of ColorChecker in low-light condition

Fig. 13. The ColorChecker image: (a) is the original set of images;

the remaining nine sets of images are the enhancement results with

modified histograms generated by the (b) THE, (c) BBHE, (d) DSIHE,

(e) RSIHE, (f) RSWHE, (g) DCRGC, (h) AWMHE, (i) CVC, and (j)

AGCWD methods 23/29

Page 24: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

• Quantitative evaluations assessed via AMBE and △E94

Table 2. AMBE assessment of contrast enhancement methods

Table 3. △E94 assessment of contrast enhancement methods

24/29

Page 25: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Enhancement of video sequence

– Provided for comparison

Fig. 14. Seven sampled frames of the “campus” sequence and the

enhancement results generated by each method. 25/29

Page 26: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Home color video and enhancement results

Fig. 15. Seven sampled frames of the “home” sequence and the

enhancement results generated by each method.

26/29

Page 27: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Using feature similarity index

• For measuring difference between TB and proposed method

Fig. 16. The FSIM of each frame generated by the TB method for

the (a) “campus” and (b) “home” sequences.

27/29

Page 28: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

– Improved rate of frames per second

• By TB method

Table 4. Performance evaluation for the proposed TB method

28/29

Page 29: Efficient contrast enhancement using adaptive gamma correction … · 2017. 6. 16. · Gamma correction techniques –Using varying adaptive parameter •Simple form of transform-based

Conclusion

Proposed method

– Novel enhancement method for images and video sequence

– Three major steps

• Histogram analysis providing spatial information of single image

− Based on probability and statistical inference

• Using weighting distribution to smooth fluctuant

− Avoiding generation of unfavorable artifacts

• Automatically gamma correction

− Using smooth curve

– Reducing computational time

29/29