Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Title 44pt Title Case
Affiliations 24pt sentence case
20pt sentence case
© ARM 2016
Introducing Mali-V61 ARM’s next generation Mali video processor
Roger Barker
ARM Technical Symposia China
Product Manager, Media Processing Group
October 31 – November 4, 2016
© ARM 2016 2
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Agenda
Introduction
Ever increasing video requirements
Video evolution
ARM approach to video
We do things differently
Mali video flexibility
Introducing Mali-V61
Multi standard, flexibility, scalability
Focus on encoding
Encode quality
Wrap up
Timelines & summary
© ARM 2016 3
Text 54pt sentence case Ever increasing video requirements
© ARM 2016 4
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
The world’s primary compute device Want to make this graphic way
different
- Smartphone represented almost as
Swiss army knife
- Phone will keep shape, but will
have multiple blades coming out of
it
- Each blade represents a use case at
the end by the device it has
replaced eg
- Camera
- Navigation device
- Music player
- Video camera
- Flashlight/torch
- Keys
- Credit cards
- Gaming device
- Computer
- Radio
- TV/Video player
© ARM 2016 5
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Live Broadcast On-demand Semi-live Real-time
Traditional TV
1926
DVR / Streaming
1999
Snapchat stories
2013
Periscope & Facebook Live
2016 and beyond
Designed for Generation Z
Based on Mary Meeker: Internet Trends 2016 - Code Conference
Just chillin
By Thomy Duva (Own work) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons
© ARM 2016 6
Text 54pt sentence case The ARM approach to video
© ARM 2016 7
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Mali Video – ARM does things differently
What?
Codec analysis, hardware acceleration or software control?
Develop hardware IP to accelerate where appropriate
Add specialized dedicated controllers for management and more
Develop firmware IP to execute requisite codecs and functions
Add cores to provide scalability
Why?
Provides flexibility, enables multi-standard, scalable, flexible codecs
Enables simultaneous encode & decode of multiple streams
Enables a degree of tailoring for our more specialist Partners…
This approach delivers a unified video solution
Mali-V500 flexibility
Hardware:
Fixed function blocks
Dedicated controllers
Control logic
Register interface
Firmware:
Codec implementation
Error concealment
Display frame reordering
Rate control
Communication between
cores
Host Communication
Decoder Binaries
H.264, VP8, MPEG4
H.263, MPEG2, VC1
Real 8/9/10
Encoder Binaries
H.264, VP8
Android driver – source code
Firmware – binaries
Hardware – RTL, integration kit
Memory/register interface
Software:
Memory allocation
Scheduling
Power gating
Android Driver
Linux Kernel Driver
Mali-V550 flexibility
Hardware:
Fixed function blocks
Dedicated controllers
Control logic
Register interface
Firmware:
Codec implementation
Error concealment
Display frame reordering
Rate control
Communication between
cores
Host Communication
Decoder Binaries Encoder Binaries
Android driver – source code
Firmware – binaries
Hardware – RTL, integration kit
Memory/register interface
Software:
Memory allocation
Scheduling
Power gating
Android Driver
Linux Kernel Driver
HEVC Main 10 High Tier H.264, H.263, MPEG4, VP8
MPEG2, VC1, Real 8/9/10
JPEG
HEVC Lite H.264, VP8
JPEG
© ARM 2016 10
Text 54pt sentence case Introduction to Mali-V61
Mali-V61 flexibility
Hardware:
Fixed function blocks
Dedicated controllers
Control logic
Register interface
Firmware:
Codec implementation
Error concealment
Display frame reordering
Rate control
Communication between
cores
Host Communication
Decoder Binaries Encoder Binaries
Android driver – source code
Firmware – binaries
Hardware – RTL, integration kit
Memory/register interface
Software:
Memory allocation
Scheduling
Power gating
Android Driver
Linux Kernel Driver
VP9 10-bit Profile 2
VP9 Profile 0 HEVC
Main 10 High Tier, H.264, H.263,
MPEG4, VP8 MPEG2, VC1, Real
8/9/10 , JPEG
VP9 10-bit Profile 2
VP9 Profile 0 HEVC
Main 10 High Tier H.264, VP8 , JPEG
© ARM 2016 12
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Mali Video simultaneously encodes and decodes
Ideal for conferencing
Sharing what you see
Can use multiple codecs simultaneously
Enabling Generation Z to multitask
Mali-V61 ‘freedom of use’
1080p30
1080p30
1080p30
4K UHD
2160p30
1080p30
720p30
720p30
© ARM 2016 13
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
-
200
400
600
800
1,000
1080p60 4K30 4K45 4K60 4K90 4K120
28 HPM@ 600MHz
Mali-V61 scalable from 1080p60 to 4K120
I Core 2 Core 3 Core 4 Core 6 Core
Mp/s
8 Core
Security camera
© ARM 2016 14
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Mali-V61 focus on high quality real-time encoding
VP9 encode available to mobile
High quality, 10-bit Profile 2 or 8-bit Profile 0 encoding
Reference Frame Scaling support for both Encode and Decode
Significantly improve our HEVC encoder
Fully support HEVC Main 10 Profile to Level 5.2 High Tier
Add B-frames and 10-bit encode support
General improvements – apply to all encoders
Finer granularity to improve coding for non-uniform motion
Redesign of motion estimation engine improves fast moving content
© ARM 2016 15
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Mali-V61 JPEG encode capabilities
No of Cores Sampling Max
Resolution Pixel Rate Example Resolutions
Single YUV420
8192 x 8192 166 Mpixel/s 1920 x1080 @ 80 fps
Single YUV422
8192 x 8192 125 Mpixel/s 1920 x1080 @ 60 fps
Four YUV420 8192 x 8192 660 Mpixels/s 3840 x 2160 @ 80 fps
7680 x 4320 @ 20 fps
Four YUV422 8192 x 8192 500 Mpixels/s 3840 x 2160 @ 60 fps
7680 x 4320 @ 15 fps
Encode performance based on cores running at 450 MHz
It is possible to encode Multi-shot JPEG and any video codec simultaneously
© ARM 2016 16
Text 54pt sentence case Encode quality
© ARM 2016 17
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Text 30pt sentence case
Mali-V61 encode quality – 4K UHD 2160p Based on bit exact alpha firmware model
VP9
HEVC
V550 H.264
New Foreman
Bitrate (Mbps) @ 30fps
PSN
R (
dB
)
34
36
38
40
42
44
46
48
50
0 2 4 6 8 10
32
34
36
38
40
42
44
46
48
0 2 4 6 8 10
Coastguard
Bitrate (Mbps) @ 30fps
PSN
R (
dB
) 55%
Saving
56%
Saving
© ARM 2016 18
Text 54pt sentence case Mali-V61 timelines & summary
© ARM 2016 19
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Timeline
Binary model evaluation tool
Alpha available now
Beta release 14th December 2016
EAC release March 2017
Hardware
EAC release 14th December 2016
Firmware
EAC release March 2017
Software
ViDDK r4p0 EAC release April 2017
© ARM 2016 20
Title 40pt Title Case
Bullets 24pt sentence case
Sub-bullets 20pt sentence case
Text 30pt sentence case
Mali-V61 summary Providing state of the art codec support
~50% Bit-rate
savings
10-bit
4KUHD encode/decode
32MP Multi-shot at
20 FPS
10-bit
VP9 encode/decode
10-bit
HEVC encode/decode
The trademarks featured in this presentation are registered and/or unregistered trademarks of ARM Limited
(or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be
trademarks of their respective owners.
Copyright © 2016 ARM Limited
Confidential © ARM 2016
Thank you