Embed Size (px)
DESCRIPTION
Development of a 4K Main 10 Profile HEVC Encoder for Great Improvements in Compression Efficiency Oliver.Gunasekara, CEO & Co-founder NGCodec Inc.
Citation preview
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Development of a 4K Main 10 Profile HEVC Encoder for Great Improvements in Compression Efficiency
[email protected] CEO & Co-founder
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Founded in 2012
Product: Silicon IP - H.264/5 (VP8/9) CODEC IP
Team has been working 6 years in the standard, Championed 10-bit
4th generation HW (RTL) video encoder since 2006
Uniquely focussed on both FPGA ‘soft’ and ASIC/SoC ‘hard’ IP
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
NGCodec go to market strategy
!H.265/H.264 encoder IP (4kp60 10-bit
1 frame latency)
FPGA IP
SoC IPMobile TV/STB
Broadcast encoders Surveillance
Camera
Telepresence
NG
Server offload
Automotive
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Why UHD?
480i 1080p 2160p
HDTV (Rec 709)
UHDTV (Rec 2020)
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
MBy
tes
0
400
800
1200
1994 2003 2013 Uncompressed
History of Video Codecs
AVC/H.264
HEVC/H.265
576i24 File size, same quality
MPEG-2/H.262
53 DVD’s
20
40
60
Num
ber o
f DVD
’s
0
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Implementation challenges
Inter-picture prediction (ME) complexity
Intra-picture prediction complexity
Mode decision (RDO)
Look-ahead mechanism, pre-processing and two-pass
Efficient Interlace support
17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2
18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34
0 : Intra_Planar1 : Intra_DC
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Software encoding video will be too expensive
Quality level increasing
0
200
400
600
800
1000
1200
1400
HD UHD (4K)
1,344
21021
H.264/AVC (Today) H.265/HEVC (2015+)
Intel i7 power (W) to encode in realtime
480i 1080p 2160p
64x
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Solution: Use an FPGA accelerator techPo
wer
(W)
0
350
700
1,050
1,400
UHD (4K)
i7 Power (Watts)FPGA Power (Watts)
20
1,344
67x
Field Programmable Gate Array (FPGA) server card
Field programmed with application which changes the hardware Performance is up to 1000X software but its harder to program New faster/bigger FPGA chips every year from Xilinx/Altera/Microsemi
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Apical Assertive Vision detects the most important parts of the scene
NGCodec Harrier encoder uses this data to encode the video, prioritizing bits
Both designs run at 4K 2160p60 in real time in a small amount of silicon
Region Of Interest based Encoding
Reduced file size Higher perceptual quality
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Region Of Interest based Encoding
QP26 - 5.3Mbps QP36 (QP26 face) - 1.5Mbps
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
‘Harrier’ H.265/HEVC Encoder Product Description
50%
60%
70%
80%
90%
100%
HM (T
heor
etica
l)
NGCo
dec
(Hig
h)
NGCo
dec
(Bas
e)
NGCo
dec
(Low
)
88%92%95%100%
H.265 compression efficiency
Reference frame cache
HEVC, AVC 1080p60 encoder elements
HEVC 1080p60 encoder
elements
Vide
o fra
me
dist
ribut
ion
Memory interface
HEVC 1080p60 encoder
elements
HEVC 1080p60 encoder elements
Control register interface
Rate control micro-processor
NAL and VQ micro-processor
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
‘Harrier’ Architecture - Parallelism via WPP
1 engine, no WPP for 1080p
4 engines, 4-way WPP for 4K resolution
Engine 1Engine 2
Engine 3Engine 4
WPP Processing of 4K (2160p) frame
Reference frame cache
HEVC, AVC 1080p60 encoder elements
HEVC 1080p60 encoder
elements
Vide
o fra
me
dist
ribut
ion
Memory interface
HEVC 1080p60 encoder
elements
HEVC 1080p60 encoder elements
Control register interface
Rate control micro-processor
NAL and VQ micro-processor
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Architecture - MicroprocessorsMicroprocessor 1 - replicated per engine • Motion estimation control • Inter block partitioning control Microprocessor 2 - replicated per engine • Mode Decision • Intra prediction decision • Intra block partitioning Microprocessor 3 - one globally • NAL unit processing • Visual quality frame level optimization Microprocessor 4 - replicated per engine • Rate control Microprocessor 5 - one globally • Look ahead control
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
NGCodec Intra prediction Performance
25
30
35
40
45
50
0 10000 20000 30000 40000 50000 60000
BasketballDrill
NGCodec_Intra
Exhaustive_HMSplit
Algorithm has very close performance to the HM with a fraction of the complexity and usage of resources
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Summary
First generation SW H.265/HEVC encoders are available:
but not delivering all the possible benefits
Enhanced HW encoders progressively will deliver:
Higher compression efficiency
Wider color gamut
HDR
© 2014 NGCodec Inc. All rights reserved. Proprietary and confidential.
Download the slides
http://ngcodec.com/imtc14
![Complexity Reduction of 3D-HEVC Based on Depth Analysis ......partitioning was performed by the 3D-HEVC Test Model encoder (HTM) [12]. It is noticeable that those objects in the foreground](https://img.pdfslide.net/doc/110x75/5fe6ec55a74a7d42f63c38bf/complexity-reduction-of-3d-hevc-based-on-depth-analysis-partitioning-was.jpg)
