PowerPoint Presentation
JPEG emerging standards
Prof. Touradj EbrahimiJPEG Convener18 February
20161www.jpeg.org
JPEG Family of Standards18 February 2016www.jpeg.org2
XS
JPEG a strong and fast growing ecosystem18 February
2016www.jpeg.org3
Source: KPCB 2014 Internet Trends, estimates based on publicly
disclosed company data.
1995-96 Technology and EngineeringEmmy award (together with
MPEG-2)
JPEG 2000 great impact on professional markets18 February
2016www.jpeg.org4
2015 Technology and EngineeringEmmy award (JPEG 2000
interoperability)
4
JPEG 2000 framework18 February 2016www.jpeg.org5Part 1/13Core
CodecPart 2 ExtensionsPart 10 3D ExtensionsPart 9JPIPPart 3MJPEG
2000Part 6JPM
Image Codec ToolsFile FormatPart 8JPSECPart 11JPWLPart
14JPXMLE2E Toolset
Extra FunctionalityCodec ToolsPart 4 Compliance TestingPart 5
Reference SoftwarePart 12ISO Base Media
JPEG XR bridging a gap18 February
2016www.jpeg.org6ComplexityPerformanceJPEG
JPEG XR
JPEG vs JPEG 2000 vs JPEG XR18 February 2016www.jpeg.org7
Illustrate the gradual increase in complexity and
functionalityFile Format: address the issue of many file formats
around and attempts to create consistency/interoperability ->
box-based file format based on Apple Quicktime = ISO Base File
Format7
JPEG XR not widely used!18 February 2016www.jpeg.org8
8
JPSearch18 February 2016www.jpeg.org9
F. Temmermans, F. Dufaux and P. Schelkens, JPSearch: Metadata
Interoperability During Image Exchange, IEEE Signal Processing
Magazine, vol.29, no. 5, pp.134-139, 2012
F. Temmermans, F. Dufaux and P. Schelkens, JPSearch: Metadata
Interoperability During Image Exchange, IEEE Signal Processing
Magazine, vol.29, no. 5, pp.134-139, 2012
9
Other standards in Progress18 February
2016www.jpeg.org10Advanced Image Coding (AIC)Evaluation
methodologies and metricsJPEG SystemsConsolidated system layer
structureJPEG XTJPEG backward compatible HDR compression
10
Advanced Image Coding (AIC)Advanced Image CodingPart 1:
Guidelines for codec evaluationPart 2: Evaluation procedure for
assessing visually lossless codingCall for information issued in
February 2015 to receive information on next generation still image
compression with superior compression efficiency, as well as other
useful features needed in future multimedia applicationsPCS 2015
Feature Event - Evaluation of current and future image compression
technologiesICIP 2016 Image Compression Grand Challenge -
Evaluation of innovative ideas for image compression technologies
when compared to existing standards. 18 February
2016www.jpeg.org11
Advanced Image Coding (AIC)18 February 2016www.jpeg.org12
woman
JPEG XT backward compatible HDR18 February 2016www.jpeg.org13A
JPEG legacy backward compatible HDR image compression standard
Forward compatibility is the ability of a design to gracefully
accept input intended for later versions of itself. The concept can
be applied to entire systems, electrical interfaces,
telecommunication signals, data communication protocols, file
formats, and computer programming languages. A standard supports
forward compatibility if older product versions can receive, read,
view, play or execute the new standard gracefully, perhaps without
supporting all new features.In telecommunications and computing, a
product or technology is backward compatible (BC)[1] or downward
compatible if it can work with input generated by an older product
or technology such as a legacy system.[2] If products designed for
the new standard can receive, read, view or play older standards or
formats, then the product is said to be backward-compatible;
examples of such a standard include data formats and communication
protocols. Modifications to a system that do not allow backward
compatibility are sometimes called "breaking changes."
13
JPEG XT design principlesExif and JFIF use APP marker of
JPEGReserved for application segments18 February
2016www.jpeg.org14APP marker (0 to 15)FormatAPP0JFIF,
JFXXAPP1ExifAPP2ICC ProfileAPP3JPSearch Part2APP14Adobe
SOIAPP1DQTDHTSOFstreamSOSEOIWG1N5725Start of Image
(SOI)APP11(Residual JPEG XT)JPEG-1 Code-streamEnd of Image
(EOI)JPEG XT File
JPEG XT design principlesTwo-layer coding, with base layer a
legacy JPEG coded LDR and enhancement layer the residual to produce
the HDREnhancement layer uses as much as possible JPEG Legacy
coding tools
18 February 2016www.jpeg.org15
JPEG XT profiles18 February 2016www.jpeg.org16
JPEG XT compression efficiency18 February 2016www.jpeg.org17
JPEG XT status18 February
2016www.jpeg.org18PartTitleWDCDDISFDISIS1Core Coding
System13/0113/0714/01-14/102Coding of High Dynamic Range
Images13/1014/0114/04-14/103Box File Format
14/0514/0715/02-15/064Conformance Testing
15/0216/0216/06-17/025Reference Software 14/0715/0616/02-16/066IDR
Integer Coding 14/0514/0715/0215/0616/02
7HDR Floating-Point Coding 14/0514/0715/0215/0616/028Lossless
and Near-lossless Coding 14/0715/0215/06-16/029Alpha Channel Coding
14/1015/0215/06-16/02
JPEG Privacy & Security18 February 2016www.jpeg.org19
SOIAPP1 (Exif)EOISOIAPP1 (Exif)EOIAPP11(protected
metadata)JPEG-1 decoderJPEG Privacy & SecuritydecoderAPP1
(Exif)APP1 (Exif)original JPEGcodestreamJPEG compatiblecodestream
withdata protectionImage DataImage dataAPP11(protectedimage
data)Image DataAPP11(protected metadata)Image
dataAPP11(protectedimage data)APP3 (JPSearch)APP3 (JPSearch)APP3
(JPSearch)
Should pictures be flat?18 February 2016www.jpeg.org20
JPEG PLENOJPEG PLENO targets a standard framework for the
representation and exchange of new imaging modalities such as
light-field, point-cloud and holographic imaging.18 February
2016www.jpeg.org21
Plenoptic representation of visual information7D function
P(a,q,l,t,x,y,z)view pointwavelengthtime
18 February 2016www.jpeg.org22
JPEG PLENO design principlesOne or limited number of
representation modelsWell defined, specific and useful
milestonesBackward compatible with legacy JPEG18 February
2016www.jpeg.org23
Panorama360 degree
Spatial photo
Point cloudLight field
Holography
Spatial PhotographyMotion parallax18 February
2016www.jpeg.org24
Point-cloud Photography18 February 2016www.jpeg.org25
Light-field Photography18 February 2016www.jpeg.org26
Light-field Photography18 February 2016www.jpeg.org27
Light-field Photography18 February 2016www.jpeg.org28
Holography18 February 2016www.jpeg.org29
Holographic Microscopyamplitudephase
JPEG PLENO WorkshopWarsaw, Poland June 23rd, 2015 Marriott Hotel
Warsaw14:00 Touradj Ebrahimi (JPEG Convenor - EPFL): "JPEG PLENO -
Introduction and Scope"
Light-fields14:15 Christian Perwa (Raytrix GmbH, Germany):
"Metrically Calibrated Multi-focus Plenoptic Camera and its
Applications"14:40 Joachim Keinert (Fraunhofer IIS, Germany):
"Lightfield media production using camera arrays - use cases and
requirements"14:55 Peter Kovacs (Holografika, Hungary): "Light
Field Displays"15:20 Atanas Gotchev (Tampere University of
Technology): "Content creation for light-field displays"15:35 Roger
Olsson (Mid Sweden University): "Objective evaluation and SotA
compression solutions for plenoptic image content"15:50 Discussion
on compression of light field data (Requirements, use cases,
technologies)
Point-clouds16:30 Rufael Mekuria (CWI Netherlands): "Point Cloud
Compression"16:45 Discussion on compression of point cloud data
(Requirements, use cases, technologies)
Holography16:55 Magorzata Kujawinska (Warsaw University of
technology): "Holographic capturing and rendering systems, suitable
data representations for phase and amplitude"17:10 Frederic Dufaux
(TELECOM ParisTech, France): "Digital Holography Compression"17:35
Discussion on compression of holographic data (Requirements, use
cases, technologies)17:50 Conclusions18 February
2016www.jpeg.org30
ICME 2016 Light-field image compression Grand Challenge18
February 2016www.jpeg.org31
JPEG XS Light weight / Low Latency Image CodingModest
compression Transparent qualityLow complexityLow latency18 February
2016www.jpeg.org32
XS
JPEG XS Light weight / Low Latency Image CodingSeveral
applications identified:Broadcast applications and live
productionLive-productionDigital CinemaIndustrial
visionProfessional audio visual systemsConsumer TVMobile
videoCamera array based recordingsUltra high frame rate
camerasMedical ImagingVideo Surveillance and securityAutomotive
InfotainmentCamera manufacturersSet-top boxesLow-cost visual
sensors in Internet of Things (IoT)HMD displaysFrom the above a set
of requirements and optional features extracted18 February
2016www.jpeg.org33
New Work Item
JPEG XS Transport over video links and IP network
18 February 2016www.jpeg.org34FormatThroughputPhysical
linkCapacityCompression2K / 60p / 422 / 10 bits2.7 GbpsHD-SDI1.33
Gbps~ 22K / 120p / 422 / 10 bits5.4 GbpsHD-SDI1.33 Gbps~ 44K / 60p
/ 422 / 10 bits10.8 Gbps3G-SDI2.65 Gbps~ 42K / 60p / 422 / 10
bits2.7 Gbps1G Ethernet (SMPTE2022 1/2)0.85 Gbps~ 32K / 60p / 444 /
12 bits4.8 Gbps1G Ethernet (SMPTE 2022 6)0.85 Gbps~ 64K / 60p / 422
/ 10 bits10.8 Gbps10G Ethernet(SMPTE2022 1/2)8.5 Gbps~ 1.33x [4K /
60p / 422 / 10 bits]32.4 Gbps10G Ethernet(SMPTE2022 6)7.96 Gbps~
44K / 60p / 444 / 12 bits19 Gbps10G Ethernet(SMPTE2022 1/2)8.5
Gbps~ 2.22x [4K / 60p / 444 / 12 bits]37.9 Gbps10G
Ethernet(SMPTE2022 6)7.96 Gbps~ 58K / 120p / 422 / 10 bits85
Gbps25G Ethernet21,25 Gbps~ 4
JPEG XS work plan and schedule18 February
2016www.jpeg.org35MeetingStatusDate71st JPEG meetingCfP16/0272nd
JPEG meetingSubmission of proposals16/06-16/1073rd JPEG
meetingWD116/1074th JPEG meetingWD217/0275th JPEG
meetingCD17/0676th JPEG meetingDIS17/1078th JPEG meetingIS18/06
ConclusionsJPEG is exploring several paths to serve future
imaging needsAdvanced Image CodingJPEG XTJPEG Privacy &
SecurityJPEG PLENOJPEG XSTwo exciting workshops have been organized
on Tuesday 23rd February 2016 during JPEG meeting in La Jolla, CA
JPEG XS Workshop Use cases for a low-latency lightweight image
coding systemJPEG Privacy & Security 2nd Workshop
18 February 2016www.jpeg.org36
More information18 February 2016www.jpeg.org37
Prof. Touradj EbrahimiJPEG Convener
cole Polytechnique Fdrale de Lausanne (EPFL)
[email protected] Prof. Peter SchelkensJPEG Public
Relations ChairJPEG Coding & Analysis Chair
Vrije Universiteit Brussel - iMinds
[email protected]
www.jpeg.org/contact.html
Acknowledgements
Tim Bruylants, Antonin Decampe, Jamie Delgago, Karel Fliegel,
Philippe Hanhart, Takaaki Ishikawa, Lukas Krasula, Fernando
Pereira, Antonio Pinheiro, Martin Rerabek, Thomas Richter, Gael
Rouvroy, Peter Schelkens, Frederik Temmermans18 February
2016www.jpeg.org38
Questions?18 February 2016www.jpeg.org39
XS
