HEVC the Next Big Thing

HEVC, The Next Big Thing?

Cyrille Berson, Director of Product Management

June 2013

Agenda

• What is HEVC?

• HEVC comparison with AVC

• Benefits and challenges of HEVC

1080i content with HEVC

What is the optimal architecture ?

• HEVC new market opportunities

Extending HD video delivery

• Market timeline

• Envivio’s approach

• VOD demo: 1080p30 at 3.0Mbps

2

1993 1995 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013

MPEG-1 Part 2(Video-CD)

H.262/MPEG-2 Part 2(DVD Video, Blu-ray, Digital Video

Broadcasting, SVCD)

1990

H.261(Visio-conf)

H.263(Visio-conf)

MPEG-4 Part 2(Video on Internet )

H.264/MPEG-4 Part 10(DVD Video, Blu-ray, Digital Video

Broadcasting, SVCD)x 2

H.265/HEVC(DVD Video, Blu-ray, Digital Video

Broadcasting, SVCD)x 2

• High Efficiency Video Codec, aka H.265

• Jointly developed by ISO/IEC MPEG and ITU-T VCEG group (JCT-VC)

• Primary goal: 50% better compression than H.264

• Resolutions up to 8,192 x 4320 (8K)

• 2013, January: ITU-T H.265, ISO/IEC 23008-2

• Royalties pending

• Next Scalable HEVC

HEVC-3D

HEVC | What is it?

3

HEVC comparison with AVC

• Classical hybrid video coding scheme

• Some features from H.264/MPEG-4 AVC

• High level syntax

• Multiple references

• Flexible GOP structure

• Weighted prediction

• Quantization

• Binary arithmetic coding engine

• Many new features


• CU is either inter or intra

• CU divided into PU

• Predefined set of partitions

• Square only in intra

Functionality H.264/MPEG-4 AVC HEVC

Block partitioning Square, symmetric Square, symmetric,

asymmetric


Functionality H.264/MPEG-4 AVC HEVC

Intra prediction 9 modes 35 modes

Intra mode prediction 1 MPM 3 MPMs

17

16

15

14

13

12

11

10

9 8

7 6

5 4

3 2

18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34

0 : Intra_Planar

1 : Intra_DC


7

HEVC AVC

Intra prediction 33 modes

Prediction depending on PU size

8 modes

Motion prediction Based on multiple candidate vectors

Motion merge mode

Improved skip mode

Based on 1 vector

Inter prediction Blocks up to 64x64

Based on DCT interpolation (DCT-IF)

Blocks up to 16x16

Bilinear interpolation

Transform and

quantization

TU from 4x4 to 32x32

Better integer transform

Quantization at CU level depending on CU size

4x4 and 8x8

Entropy coding CABAC only CABAC + CAVLC

Loop filters Deblocking filter

Adaptive loop filter

Sample adaptive offset

Deblocking filter

Interlaced modes Progressive tools only Interlaced and progressive tools

HEVC | Technical Challenges

• No interlaced support as in AVC

• HEVC increases encoding complexity Requires more horsepower (2 to 3 times more)

No encoding chipsets available, SW is the only solution

• Players Hardware: STB chipsets in development not mature yet

Software: Decoders developed for PC, tablets and smartphones

− 720p30 decoding on tablets

8

HEVC | Process 1080i content with HEVC?

• HEVC designed for progressive material encoding • All targeted displays are progressive

• Broadcast world still massively using interlaced video content • Legacy SD contents

• 15 years of 1080i contents (still counting)

• H.264/MPEG-4 AVC

• Picture Adaptive Frame Field (PAFF)

• Macroblock Adaptive Frame Field (MBAFF)

• Concerns about efficiency of HEVC on interlaced material?

• Syntax is available • Field or Frame coding signaling possible through VUI/SEI

− Signaling constrained to Coded Video Sequence (CVS)

− Adaptive Frame/Field switching possible on IDR only using SEI

− SEI message not mandatory for decoder conformance

HEVC | Interlacing in HEVC

HEVC Field Coding

Interlaced source Interlaced encoded frame

Separate fields Interlace

Fields Encoded fields

HEVC Frame Coding



Separate fields Interlace

Fields Encoded fields

Encoded interlaced frame Interlaced frame

GOP Decision

Field/Frame?

HEVC Frame Coding

HEVC Field Coding

Frame only coding

Field only coding

Sequence adaptive field frame coding (SAFF)

- Reference:

AVC

- Sequences set:

progressive

HEVC frame

~Bit rate savings* (YUV) -34%


*sources: JCTVC-K0250, JCTVC-K0331

- Reference:

AVC with PAFF+MBAFF

- Sequences set:

interlaced

HEVC frame

HEVC field

HEVC SAFF

~Bit rate savings* (YUV) -3% -29% -33%

- Reference:

AVC with PAFF+MBAFF

- Sequences set:

interlaced

HEVC field

~Bit rate savings* (YUV) -29%


• HEVC is handling efficiently interlaced video contents

• Field coding is satisfactory

• Additional gain is possible with SAFF, provided − A good frame field switching decision at the encoder

− A decoder compliant with SAFF SEI message

• Creation of the Interlace AhG

• 103th MPEG meeting, January 2013

• No evidence showing additional interlace coding tools are

needed

Files

SDI

ASI

A/V

Extract

Video

Analysis Processing Codecs WrapDASH, HLS,

HDS, HSS…

SPTS over IP

RTP,…

OTT

FilesRC Targets VBV info

StatMux

AllocatorMultiplexer MPTS

Complexities

HEVC | Encoding Architecture

• Requirements

• Implement existing and new codec

• Consider pre-processing depending on use cases − field splitting, de-interlacing, inverse telecine

− Multiple resolutions (Mobile)

• And also appropriate inputs and outputs

HEVC | Encoding Architecture

• Software solution

• Easy reconfiguration

• 1 to N (Mobile)

• 1 to 1 (4k HEVC)

• N to N (Broadcast)

• Easy hardware upgrade • Abstraction to platform (OS)

• Easy software upgrade

• Benefits from HEVC encoding technology performance

progression

OS

SW

… HW …

HEVC | Extending HD video delivery

• New broadcast networks

• Terrestrial (DVB-T2) − 40 Mbps

• Satellite (DVB-S2)

• 30 to 60 % bandwidth increase

• Current demand

• Extension of HDTV channels

• New demand

• 4K/UHD announced

• TV displays starting to be available

• 4K/UHD contents already produced for a few years (TV series)

• HEVC particularly efficient on very high resolutions.

• 51 to 74% reported subjective gains

4K HD SD

HEVC | Extending HD video delivery

• Telecom access network (telco)

• 100Mbps for 4G (from 3Mbps for 3G)

• Demand

• Unicast video delivery − Bandwidth divided by users number

• New generation of mobile terminals − Smartphone and tablets

− Supporting HDTV or even higher resolution

• Expected growth for mobile video in the coming years: 75%

• Telcos are already under pressure

• HEVC allows encoding 720p for small screens at 1 Mbps

HEVC | Consumer Market Potential

17

HEVC | Target Client Devices

• First targets PCs, tablets and

smartphones Yearly updates

Software decoders

Decoding chipsets will be ready in 2013

• HEVC decoding in consumer

devices

18

0

500

1000

1500

2000

2500

3000

3500

4000

4500

5000

2011 2012 2013 2014 2015 2016

Insta

lled

ba

se

in

mill

ion

s

Smartphones

Tablets

Set Top boxes

Digital TV sets

Devices HEVC decode capable (Source MRG)

HEVC | Market Timeline

19

H1 2013 H2 2013 H1 2014 H2 2014 H1 2015 H2 2015

HEVC encoding

4K VOD

HEVC encoding

4K Live

HEVC encoding

HD 1080p

FIFA World cup

4K broadcast

(Japan)

HEVC standard

validation

First HEVC

Decoders

(1080p)

First HEVC

deployments

for OTT (VOD then Live)

HEVC

Lab trials

First commercial

services in 4K

HEVC | Benefits

• Telcos Same quality at lower bitrate

Increase IPTV eligibility

HD over 4G networks

− Bring HD to nomad viewers

• OTT cut CDN costs in half

• Cable/DTT/DTH Launch 4K services

Higher resolutions within the same bandwidth

20

Envivio’s Advantages

• 4Caster G4 is built to support HEVC Future proof platform

• Early Time To Market Own software codec, designed from ground up

Unlike HW vendor, not dependent on 3rd party encoding chipsets

• HEVC is just a software update Add HEVC support to Envivio installed base

• HEVC work will help enhance H.264 and MPEG-2 performance

21

HEVC | Envivio Split-Screen Demo

22

• HEVC vs. AVC • Use case: same objective video quality

• Source video content: 1080P@30 fps

• Encodings: HEVC @ 3Mbps & AVC @ 6Mbps

• HEVC stream generated with the HM (offline encoding)

YUV

source

HEVC

encoding

HEVC

decoding

HEVC & AVC

Side by side

AVC

encoding

AVC

decoding

YUV

Thank You

Documents

HEVC the Next Big Thing