63
Digital Image Digital Image Processing Processing Image Image Compression Compression

Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: [email protected]@uettaxila.edu.pk

Embed Size (px)

Citation preview

Page 1: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Digital Image Digital Image ProcessingProcessing

Image CompressionImage Compression

Page 2: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENTU.E.T TAXILAEmail:: [email protected] Room #:: 7

Page 3: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

3

Background

Principal objective:To minimize the number of bits required to represent an image.ApplicationsTransmission:Broadcast TV via satellite, military communications via aircraft,

teleconferencing, computer communications etc.Storage:Educational and business documents, medical images (CT, MRI and digital radiology), motion pictures, satellite images, weather maps, geological surveys, ...

Page 4: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

4

Overview

Image data compression methods fall into two common categories:

I. Information preserving compression Especial for image archiving (storage of legal or medical records) Compress and decompress images without losing information

II. Lossy image compression Provide higher levels of data reduction Result in a less than perfect reproduction of the original image Applications: –broadcast television, videoconferencing

Page 5: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

5

Page 6: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

6

Data vs. information

• Data is not the same thing as information

• Data are the means to convey information; various amounts of data may be used to represent the same amount of information Part of data may provide no relevant information: data redundancy

• The amount of data can be much larger expressed than the amount of information.

Page 7: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

7

Data Redundancy

• Data that provide no relevant information=redundant data or redundancy.

• Image compression techniques can be designed by

reducing or eliminating the Data Redundancy

• Image coding or compression has a goal to reduce the amount of data by reducing the amount of redundancy.

Page 8: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

8

Data Redundancy

Page 9: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

9

Data RedundancyThree basic data redundancies

Coding Redundancy Interpixel Redundancy Psychovisual Redundancy

Page 10: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

10

Coding Redundancy

A natural m-bit coding method assigns m-bit to each gray

level without considering the probability that gray level occurs

with: Very likely to contain coding redundancy

Basic concept: Utilize the probability of occurrence of each gray level

(histogram) to determine length of code representing that particular gray level: variable-length coding.

Assign shorter code words to the gray levels that occur most frequently or vice versa.

Page 11: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

11

Coding Redundancy

Page 12: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

12

Coding Redundancy (Example)

Page 13: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

13

Coding Redundancy (Example)

Page 14: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

14

Coding Redundancy (Example)

Page 15: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

15

Interpixel Redundancy

Caused by High Interpixel Correlations within an image, i.e., gray level of any given pixel can be reasonably predicted from the value of its neighbors (information carried by individual pixels is relatively small) spatial redundancy, geometric redundancy, interframe redundancy (in general, interpixel redundancy )

To reduce the interpixel redundancy, mapping is used. The mapping scheme can be selected according to the properties of redundancy.

An example of mapping can be to map pixels of an image: f(x,y) to a sequence of pairs: (g1,r1), (g2,r2), ..., (gi,ri), ..

gi: ith gray level ri: run length of the ith run

Page 16: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

16

Interpixel Redundancy (Example)

Page 17: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

17

Psychovisual Redundancy

The eye does not respond with equal sensitivity to all visual information.

Certain information has less relative importance than other information in normal visual processing psychovisually redundant (which can be eliminated without significantly impairing the quality of image perception).

The elimination of psychovisually redundant data results in a loss of quantitative information lossy data compression method.

Image compression methods based on the elimination of psychovisually redundant data (usually called quantization) are usually applied to commercial broadcast TV and similar applications for human visualization.

Page 18: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

18

Psychovisual Redundancy

Page 19: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

19

Psychovisual Redundancy

Page 20: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

20

Psychovisual Redundancy

Page 21: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

21

Fidelity Criteria

Page 22: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

22

Fidelity Criteria

Page 23: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

23

Fidelity Criteria

Page 24: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

24

Image Compression Models

The encoder creates a set of symbols (compressed) from the input data. The data is transmitted over the channel and is fed to decoder. The decoder reconstructs the output signal from the coded symbols. The source encoder removes the input redundancies, and the channel encoder increases the noise immunity.

Page 25: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

25

Source Encoder and Decoder

Page 26: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Error-Free Compression

26

Page 27: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Variable-length Coding Methods: Huffman Coding

27

Page 28: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Variable-length Coding Methods: Huffman Coding

28

Page 29: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

29

Page 30: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Mapping

30

•There is often correlation between adjacent pixels, i.e. the value of the neighbors of an observed pixel can often be predicted from the value of the observed pixel. (Interpixel Redundancy).

•Mapping is used to remove Interpixel Redundancy.

•Two mapping techniques are:

Run length coding Difference coding.

Page 31: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

31

Page 32: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

32

Page 33: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

33

Page 34: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

34

Page 35: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

35

Page 36: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Other Variable-length Coding Methods

Page 37: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

LZW Coding

Lempel-Ziv-Welch (LZW) coding assigns fixed length code words to variable length sequences of source symbols.

37

Page 38: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Example

38

Page 39: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

39

Page 40: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Bit-Plane Coding

Page 41: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Bit-Plane Coding

Page 42: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Bit-Plane Decomposition (Example)

Page 43: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Bit-Plane Decomposition (Example)

Page 44: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Bit-Plane Decomposition (Example)

Page 45: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Binary Image Compression

Page 46: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Binary Image Compression: Constant Area Coding (CAC)

Page 47: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Binary Image Compression: 1-D Run-Length Coding (1D RLC):

Page 48: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk
Page 49: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Lossy Compression

• A lossy compression method is one where compressing data and then decompressing it retrieves data that may well be different from the original, but is close enough to be useful in some way.

• Lossy compression is most commonly used to compress multimedia data (audio, video, still images), especially in applications such as streaming media and internet telephony.

Page 50: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk
Page 51: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG

• Lossy Compression Technique based on use of Discrete Cosine Transform (DCT)

• A DCT is similar to a Fourier transform in the sense that it produces a kind of spatial frequency spectrum

Page 52: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

STEPS IN JPEG COMPRESSION• Divide Each plane into 8x8 size blocks.• Transform the pixel information from the spatial domain

to the frequency domain with the Discrete Cosine Transform. (Compute DCT of each block)

• Quantize the resulting values by dividing each coefficient by an integer value and rounding off to the nearest integer.

• Arrange the resulting coefficients in a zigzag order. so that the coefficients are in order of increasing frequency. The higher frequency coefficients are more likely to be 0 after quantization. This improves the compression of run-length encoding.

• Do a run-length encoding of the coefficients ordered in this manner. Follow by Huffman coding. (Separately encode DC components and transmit data.)

Page 53: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Forward DCT

For an N X N pixel image

the DCT is an array of coefficients where

N

vy

N

uxpCC

NDCT

N

y xy

N

xvuuv 2

)12(cos

2

)12(cos

2

1 1

0

1

0

where

otherwiseCC

vuforCC

vu

vu

1

0,2

1

NvNupuv 0,0,

NvNuDCTuv 0,0,

Page 54: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSION

Page 55: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSION•The most important values to our eyes will be placed in the upper left corner of the matrix.

•The least important values will be mostly in the lower right corner of the matrix.

Semi-Important

Most Important

Least Important

Page 56: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSIONThe example image 8*8 matrix before DCT transformation.

Page 57: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSION

Gray-Scale Example:Value Range 0 (black) --- 255 (white)

63 33 36 28 63 81 86 9827 18 17 11 22 48 104 108 72 52 28 15 17 16 47 77 132 100 56 19 10 9 21 55 187 186 166 88 13 34 43 51 184 203 199 177 82 44 97 73 211 214 208 198 134 52 78 83 211 210 203 191 133 79 74 86

Page 58: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSION

2D-DCT of matrixValue Range 0 (Gray) --- -355 (Black)

-304 210 104 -69 10 20 -12 7-327 -260 67 70 -10 -15 21 8 93 -84 -66 16 24 -2 -5 9 89 33 -19 -20 -26 21 -3 0 -9 42 18 27 -7 -17 29 -7 -5 15 -10 17 32 -15 -4 7 10 3 -12 -1 2 3 -2 -3 12 30 0 -3 -3 -6 12 -1

Page 59: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSION

Cut the least significant componentsValue Range 0 (Gray) --- -355 (Black)

-304 210 104 -69 10 20 -12 0-327 -260 67 70 -10 -15 0 0 93 -84 -66 16 24 0 0 0 89 33 -19 -20 0 0 0 0 -9 42 18 0 0 0 0 0 -5 15 0 0 0 0 0 0 10 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Page 60: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

JPEG COMPRESSION

Original Compressed

RReessuulltts…s…

Page 61: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk
Page 62: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Some Common Image Formats

Page 63: Digital Image Processing Image Compression. ALI JAVED Lecturer SOFTWARE ENGINEERING DEPARTMENT U.E.T TAXILA Email:: alijaved@uettaxila.edu.pkalijaved@uettaxila.edu.pk

Some Common Image Formats