ITU-T VICA Workshop22-23 July 2005 - ITU Headquarter - Geneva

International Telecommunication Union

JPEG 2000 ExtensionsJPEG 2000 ExtensionsFrédéric Dufaux

Ecole Polytechnique Fédérale de Lausanne (EPFL)Institut de Traitement des Signaux

2ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

ISO/IEC 15444 – JPEG 2000

o Part 1 - Core coding systemo Part 2 - Extensionso Part 3 - Motion JPEG 2000 o Part 4 - Conformance o Part 5 - Reference softwareo Part 6 - Compound image file format o Part 8 - JPSEC: Secure JPEG 2000o Part 9 - JPIP: Interactivity tools, APIs and protocols o Part 10 - JP3D: Extensions for 3D datao Part 11 - JPWL: Wireless o Part 12 - ISO Base Media File Formato Part 13 – An entry level JPEG 2000 encoder

3ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

Work Plan

05/1105/0705/0304/0703/0702/07JPWL

06/0706/0305/1105/0702/1002/03JP3D

04/1004/0403/0703/0302/0702/03JPIP

05/1105/0704/1104/0402/1002/03JPSEC

ISFDISFCDCDWDCFP

4ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPSEC: Secure JPEG 2000

Services addressed:o Confidentiality

• Encryption or ciphering to conceals original contento Integrity verification

• Image data integrity: bit exact verification• Image content integrity: perceptual meaning verification

o Source authentication• Identity of the party which generated the content

o Conditional access• Restrict access to image data or parts of it

o Secure scalable streaming and transcoding• Streaming and transcoding without unprotecting the content

o …

5ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPSEC Framework

Open and flexible framework

JPSEC codestream

Proprietary Tool ID

JPSEC Syntax Parser

JPSEC Unprotection

Tools

JPSEC Syntax Writer

JPSEC Protection

Tools

JPSEC protector JPSEC unprotector

Security Services: • Confidentiality • Integrity Verification • Source Authentication• �

JPSEC Registration

Authority

Tool Description

JPSEC Tools: • Encryption (AES, DES, �) • Digital Signature (RSA, �) • Message Auth. Code • Watermarking • Proprietary Tools • �

6ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPSEC Framework

Creation and consumption of JPSEC content

JPEG-2000codestream

JPSEC codestream

JPEG-2000codestream

JPEG-2000 Decoder

JPSEC Unprotector

JPSEC Protector

JPEG-2000 Encoder

JPSEC codestream Image Image

Image

JPSECEncoder & Protector

JPSECUnprotector & Decoder

Case 1

Case 2

Case 3 JPEG-2000or JPSEC

codestream

JPSEC Protector 1

JPSEC’ JPSEC

Protector 2

JPSEC” JPSEC

Protector 3

JPSEC* JPSEC

Unprotector 3

JPSEC”

JPSEC Unprotector 2

JPSEC’

JPSEC Unprotector 1

JPEG-2000or JPSEC

codestream

Image

7ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPSEC ROI-Scrambling

o Add pseudo-random noiseo Performed in the wavelet

domaino Based on ROI mechanisms in

JPEG 2000o Efficient for arbitrary-shape

regionso Adjust distortion from

fuzziness to noiseo Application

• Video surveillance preserving privacy

8ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPIP: Interactivity tools, APIs and Protocols

o Tools for supporting image and metadata delivery in a networked environment

o Exploit JPEG 2000 properties• Random access • Codestream reordering• Incremental decoding

9ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPIP: Interactivity tools, APIs and Protocols

Protocol overview

Protocol stack

Cache

Client

Cache Model*

Server

HTTP, TCP, UDP

*Only if State is present

Image Metatdata Server Capabilities JPP- or JPT-streams

Display Metatdata Client Capabilites Data Limits Multiple Server Responses

Multiple Client Requests

JPIP

IP

TCP UDP

HTTP

10ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JP3D: Extensions for 3D Data

o Extension of JPEG 2000 parts 1 and 2o Compress samples along all three dimensionso Targets applications:

• Medical Imaging (MRI, CAT, PET scans)• Scientific Modeling and Simulation• Remote Sensing (hyperspectral imagery,

geophysical/astrophysical measurements)• …

11ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JP3D: Extensions for 3D Data

o Extends standard JPEG 2000 technology from two to three dimensions

• Wavelet transform• Quantization• Coefficient bit modeling

o New technologies• 3D context probability models for entropy

coding• Variable resolution sampling grids• Coding of floating point data

12ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPWL: Wireless

o Multimedia wireless applications are becoming ubiquitous• Sales of camera-equipped cell phones exceed those of

standalone digital cameras• Importance of efficient and robust wireless imaging solutions

o JPEG 2000 is well-suited for wireless applications• High coding efficiency → good visual quality• Seamless scalability → quality of service and pricing strategies

o JPEG 2000 Wireless (JPWL)• Efficient transmission over error-prone networks• Normative and information tools for error protection and

correction• Forward Error Correcting (FEC) codes• Header protection• Unequal Error Protection (UEP)• Data partitioning and interleaving• Robust arithmetic coding

13ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPWL: Wireless

o Headers are most important part of code stream• FEC for strong protection of Main and Tile-part headers• Add redundancy bits while keeping backward

compatibilityo Progressive quality transmission

• Layered code stream: each layer contributes to improve quality

• UEP: decreasing protection as layer importance decreases

Mai

n H

eade

r

Tile

-par

t H

eade

r

Pack

et

Pack

et

Pack

etLayer 1

high importance

……

Pack

et

Pack

et

Pack

et

Layer 2medium importance

…

Pack

et

Pack

et

Pack

et

Layer nlow importance

…

Headerscritical importance

14ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

JPWL Unequal Error Protection

384 kb/s, CIF, 15 f/s, 3 quality layersBER=10-3 (WCDMA error patterns)

JPEG 2000

JPWL

26.0324.18average

29.8027.35Soccer

18.6317.71Mobile

22.6021.19Harbor

28.0725.73Foreman

30.4328.09Crew

26.6524.98City

PSNRJPWL

PSNRJPEG 2000sequence

15ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

Motion JPEG 2000 vs MPEG-4

InaccurateAccurateRate control

HighLowCoding Delay

HighLowEncodercomplexity

MC DCTIntra-frameWaveletCoding

BlockRinging

Blur RingingArtifacts

MPEG-4Motion JPEG 2000

InefficientEfficientScalability

LowHighError resilience

16ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

Motion JPEG 2000 vs MPEG-4

128 kb/s, QCIF, 6 f/sBER=10-4 (WCDMA error patterns)

30.01

27.75

36.82

30.21

31.29

25.34

33.36

24.67

34.25

26.44

PSNRMPEG-4IPP..IPP

PSNRMotion

JPEG2000

30.32average

26.69Tempest

38.25Suzie

32.48Football

29.62Waterfall

26.90Letters

33.63Animals

22.87Mobile

35.06New York

27.41Balloons

JPEG 2000

MPEG-4

17ITU-T VICA Workshop

22-23 July 2005 - ITU Headquarter - Geneva dates

ITU-T

The End !

o Questions?