1
The Perceived Quality of Undistorted Natural Images David Kane & Marcelo Bertalmio [email protected] Experimental Section Aim: To investigate the relationship between contrast and image quality judgments. Stimuli: Generate a distribution of images that span the full range of mean luminance values and contrasts that our CRT can display via a linear scaling and shifting the luminance distri- bution of image from the high dynamic range survey by Fairchild (2007). Procedure: Subject’s rated the image quality of a small (7by7 deg) image patch on a 0-9 scale. The background luminance was either black, mid-gray or white. Six subjects took part. Results: Each data point is the average image quality score for at least 12 image quality judgments and 6 different image patches. 255 1 3 7 15 31 63 127 1 3 7 15 31 63 127 255 Standard Deviation 255 3 7 15 31 63 127 Mean Luminance 255 3 7 15 31 63 127 0 1 2 3 4 5 6 7 Average Score (a) Black (b) Gray (c) White Mean Luminance Standard Deviation 0 255 0 64 8 127 Application Luminance histogram (2) Linear scaled (3) Clipped (64) (4) Clipped (8) (5) Clipped (1/2) 1 32 256 1/32 1/256 1/2 64 8 N Redwood sunset 0 2 4 6 8 0 2 4 6 8 Image Quality 0 0.2 0.4 0.6 0 0.2 0.4 0.6 0.8 1 2 3 4 5 6 % of Clipped Pixels Image Quality (2) (1) Dynamic Range is the ratio between the greatest and the smallest luminance in an image or scene. Natural scenes may have a dynamic range of up to seven orders of magnitude. Display media has a dynamic range of between two to three orders of magnitude. Thus luminance compression is necessary for image reproduction, a process known as tone-mapping. Linear clipping is the process of clipping high or low pixel vales before renormalization to the available range. Suprisingly linear clipping achives better image quality scores than more complex tone map- ping operators (Cadik et al, 2008). Linear clipping can increase image contrast, but in- troduces clipping artifacts. We investigate image quality judgments for various levels of clipping. Results: Image quality scores can be predicted using two terms. One for contrast, another for the square root of the number of clipped pixels. Both and are image dependent. Fortunately, the values of and are linearly related (Fig. 3). Substituting, gives Although we are unable to fully discount using the average value produces a reasonable approximation of subjects image qulity scores (R=0.69, Fig. 2). Finally, our proposed tone-mapping operator finds the upper and lower clipping bounds that maximizes . Predictive model The standard deviation of the luminance image is a poor predictor of image quality scores (Fig. 1). Passing the image through a point-wise gamma function, improves the predictive power of the model (Fig 2). The value of gamma that achieves the best Spear- man’s correlation (Fig. 2, Inset) varies with the background luminance condition, consistent with research into lightness perception (e.g. Whittle, 1992). Applying a point-wise non-linearity shifts the distor- tion of standard deviations as illustrated in the inset of Fig. 3. The range of standard deviations can be renormalized to within a given range using the fol- lowing equation. Finally, the normalized standard deviation is passed through an additional non-linearity. This metric achieves a Pearson’s correlation of R=0.95 (Fig. 4). Absolute image quality scores can be predicted using the following equation that incorporates a threshold term and a gradient . Finally, we find the value of is image depen- dent as illustrated in Fig. 5. Thus we can predict relative image quality scores but not absolute image quality scores. 0 0.1 0.2 0 2 4 6 8 Average Score 0 0.1 0.2 0 2 4 6 8 Average Score Black Gray White Background 0 0.3 0.6 0 2 4 6 8 Average Score 0 0.1 0.2 0 2 4 6 8 Average Score 0 0.3 0.6 0 2 4 6 8 Average Score = 0.1 = 0.3 = 0.4 Best Gamma (1) (2) (3) (4) (5) = 1.0 = 0.3 0 4 8 12 16 -12 -8 -4 0 4 8 (3)

The Perceived Quality of Undistorted Natural Imagesip4ec.upf.edu/system/files/publications/PosterVSS.pdfpixel vales before renormalization to the available range. Suprisingly linear

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

  • The Perceived Quality of Undistorted Natural ImagesDavid Kane & Marcelo Bertalmio [email protected]

    Experimental SectionAim: To investigate the relationship between contrast and image quality judgments.

    Stimuli: Generate a distribution of images that span the full range of mean luminance values and contrasts that our CRT can display via a linear scaling and shifting the luminance distri-bution of image from the high dynamic range survey by Fairchild (2007).

    Procedure: Subject’s rated the image quality of a small (7by7 deg) image patch on a 0-9 scale.

    The background luminance was either black, mid-gray or white. Six subjects took part.

    Results:

    Each data point is the average image quality score for at least 12 image quality judgments and 6 different image patches.

    2551 3 7 15 31 63 1271

    3

    7

    15

    31

    63

    127

    255

    Standard Deviation

    2553 7 15 31 63 127

    Mean Luminance

    2553 7 15 31 63 1270

    1

    2

    3

    4

    5

    6

    7

    Average Score

    (a) Black (b) Gray (c) White

    Mean Luminance

    Stan

    dard

    Dev

    iati

    on

    0 2550

    64

    8

    127

    ApplicationLuminance histogram

    (2) Linear scaled

    (3) Clipped (64)

    (4) Clipped (8)

    (5) Clipped (1/2)

    1 32 2561/321/256

    1/2 648

    N

    Redwood sunset

    0 2 4 6 80

    2

    4

    6

    8

    Image Quality

    00.2

    0.40.6

    00.2

    0.40.6

    0.8

    1

    2

    3

    4

    5

    6

    % of Cli

    pped Pix

    els

    Image Quality

    (2)

    (1)

    Dynamic Range is the ratio between the greatest and the smallest luminance in an image or scene.

    Natural scenes may have a dynamic range of up to seven orders of magnitude.

    Display media has a dynamic range of between two to three orders of magnitude.

    Thus luminance compression is necessary for image reproduction, a process known as tone-mapping.

    Linear clipping is the process of clipping high or low pixel vales before renormalization to the available range. Suprisingly linear clipping achives better image quality scores than more complex tone map-ping operators (Cadik et al, 2008).

    Linear clipping can increase image contrast, but in-troduces clipping artifacts.

    We investigate image quality judgments for various levels of clipping.

    Results: Image quality scores can be predicted using two terms. One for contrast, another for the square root of the number of clipped pixels.

    Both and are image dependent.

    Fortunately, the values of and are linearly related (Fig. 3).

    Substituting, gives

    Although we are unable to fully discount using the average value produces a reasonable approximation of subjects image qulity scores (R=0.69, Fig. 2).

    Finally, our proposed tone-mapping operator finds the upper and lower clipping bounds that maximizes .

    Predictive modelThe standard deviation of the luminance image is a poor predictor of image quality scores (Fig. 1).

    Passing the image through a point-wise gamma function, improves the predictive power of the model (Fig 2).

    The value of gamma that achieves the best Spear-man’s correlation (Fig. 2, Inset) varies with the background luminance condition, consistent with research into lightness perception (e.g. Whittle, 1992).

    Applying a point-wise non-linearity shifts the distor-tion of standard deviations as illustrated in the inset of Fig. 3. The range of standard deviations can be renormalized to within a given range using the fol-lowing equation.

    Finally, the normalized standard deviation is passed through an additional non-linearity.

    This metric achieves a Pearson’s correlation of R=0.95 (Fig. 4).

    Absolute image quality scores can be predicted using the following equation that incorporates a threshold term and a gradient .

    Finally, we find the value of is image depen-dent as illustrated in Fig. 5.

    Thus we can predict relative image quality scores but not absolute image quality scores.

    0 0.1 0.20

    2

    4

    6

    8

    Average Score

    0 0.1 0.20

    2

    4

    6

    8

    Average Score

    BlackGrayWhite

    Background

    0 0.3 0.60

    2

    4

    6

    8

    Average Score

    0 0.1 0.20

    2

    4

    6

    8

    Average Score

    0 0.3 0.60

    2

    4

    6

    8

    Average Score

    = 0.1= 0.3= 0.4

    Best Gamma

    (1)

    (2)

    (3)

    (4)

    (5)

    = 1.0= 0.3

    0 4 8 12 16−12

    −8

    −4

    0

    4

    8

    (3)