introducing mali-v61 arm’s next generation mali video processor · 2016. 11. 4. · 3 © arm...

Title 44pt Title Case

Affiliations 24pt sentence case

20pt sentence case

© ARM 2016

Introducing Mali-V61 ARM’s next generation Mali video processor

Roger Barker

ARM Technical Symposia China

Product Manager, Media Processing Group

October 31 – November 4, 2016

© ARM 2016 2


Bullets 24pt sentence case

Sub-bullets 20pt sentence case

Agenda

Introduction

Ever increasing video requirements

Video evolution

ARM approach to video

We do things differently

Mali video flexibility

Introducing Mali-V61

Multi standard, flexibility, scalability

Focus on encoding

Encode quality

Wrap up

Timelines & summary

© ARM 2016 3

Text 54pt sentence case Ever increasing video requirements

© ARM 2016 4




The world’s primary compute device Want to make this graphic way

different

- Smartphone represented almost as

Swiss army knife

- Phone will keep shape, but will

have multiple blades coming out of

it

- Each blade represents a use case at

the end by the device it has

replaced eg

- Camera

- Navigation device

- Music player

- Video camera

- Flashlight/torch

- Keys

- Credit cards

- Gaming device

- Computer

- Radio

- TV/Video player

© ARM 2016 5




Live Broadcast On-demand Semi-live Real-time

Traditional TV

1926

DVR / Streaming

1999

Snapchat stories

2013

Periscope & Facebook Live

2016 and beyond

Designed for Generation Z

Based on Mary Meeker: Internet Trends 2016 - Code Conference

Just chillin

By Thomy Duva (Own work) [CC BY-SA 4.0 (http://creativecommons.org/licenses/by-sa/4.0)], via Wikimedia Commons

© ARM 2016 6

Text 54pt sentence case The ARM approach to video

© ARM 2016 7




Mali Video – ARM does things differently

What?

Codec analysis, hardware acceleration or software control?

Develop hardware IP to accelerate where appropriate

Add specialized dedicated controllers for management and more

Develop firmware IP to execute requisite codecs and functions

Add cores to provide scalability

Why?

Provides flexibility, enables multi-standard, scalable, flexible codecs

Enables simultaneous encode & decode of multiple streams

Enables a degree of tailoring for our more specialist Partners…

This approach delivers a unified video solution

Mali-V500 flexibility

Hardware:

Fixed function blocks

Dedicated controllers

Control logic

Register interface

Firmware:

Codec implementation

Error concealment

Display frame reordering

Rate control

Communication between

cores

Host Communication

Decoder Binaries

H.264, VP8, MPEG4

H.263, MPEG2, VC1

Real 8/9/10

Encoder Binaries

H.264, VP8

Android driver – source code

Firmware – binaries

Hardware – RTL, integration kit

Memory/register interface

Software:

Memory allocation

Scheduling

Power gating

Android Driver

Linux Kernel Driver


Hardware:



Control logic

Register interface

Firmware:


Error concealment


Rate control


cores

Host Communication

Decoder Binaries Encoder Binaries





Software:

Memory allocation

Scheduling

Power gating

Android Driver

Linux Kernel Driver

HEVC Main 10 High Tier H.264, H.263, MPEG4, VP8

MPEG2, VC1, Real 8/9/10

JPEG

HEVC Lite H.264, VP8

JPEG

© ARM 2016 10

Text 54pt sentence case Introduction to Mali-V61


Hardware:



Control logic

Register interface

Firmware:


Error concealment


Rate control


cores

Host Communication

Decoder Binaries Encoder Binaries





Software:

Memory allocation

Scheduling

Power gating

Android Driver

Linux Kernel Driver

VP9 10-bit Profile 2

VP9 Profile 0 HEVC

Main 10 High Tier, H.264, H.263,

MPEG4, VP8 MPEG2, VC1, Real

8/9/10 , JPEG

VP9 10-bit Profile 2

VP9 Profile 0 HEVC

Main 10 High Tier H.264, VP8 , JPEG

© ARM 2016 12




Mali Video simultaneously encodes and decodes

Ideal for conferencing

Sharing what you see

Can use multiple codecs simultaneously

Enabling Generation Z to multitask

Mali-V61 ‘freedom of use’

1080p30

1080p30

1080p30

4K UHD

2160p30

1080p30

720p30

720p30

© ARM 2016 13




-

200

400

600

800

1,000

1080p60 4K30 4K45 4K60 4K90 4K120

28 HPM@ 600MHz

Mali-V61 scalable from 1080p60 to 4K120

I Core 2 Core 3 Core 4 Core 6 Core

Mp/s

8 Core

Security camera

© ARM 2016 14




Mali-V61 focus on high quality real-time encoding

VP9 encode available to mobile

High quality, 10-bit Profile 2 or 8-bit Profile 0 encoding

Reference Frame Scaling support for both Encode and Decode

Significantly improve our HEVC encoder

Fully support HEVC Main 10 Profile to Level 5.2 High Tier

Add B-frames and 10-bit encode support

General improvements – apply to all encoders

Finer granularity to improve coding for non-uniform motion

Redesign of motion estimation engine improves fast moving content

© ARM 2016 15




Mali-V61 JPEG encode capabilities

No of Cores Sampling Max

Resolution Pixel Rate Example Resolutions

Single YUV420

8192 x 8192 166 Mpixel/s 1920 x1080 @ 80 fps

Single YUV422

8192 x 8192 125 Mpixel/s 1920 x1080 @ 60 fps

Four YUV420 8192 x 8192 660 Mpixels/s 3840 x 2160 @ 80 fps

7680 x 4320 @ 20 fps

Four YUV422 8192 x 8192 500 Mpixels/s 3840 x 2160 @ 60 fps

7680 x 4320 @ 15 fps

Encode performance based on cores running at 450 MHz

It is possible to encode Multi-shot JPEG and any video codec simultaneously

© ARM 2016 17




Text 30pt sentence case

Mali-V61 encode quality – 4K UHD 2160p Based on bit exact alpha firmware model

VP9

HEVC

V550 H.264

New Foreman

Bitrate (Mbps) @ 30fps

PSN

R (

dB

)

34

36

38

40

42

44

46

48

50

0 2 4 6 8 10

32

34

36

38

40

42

44

46

48

0 2 4 6 8 10

Coastguard

Bitrate (Mbps) @ 30fps

PSN

R (

dB

) 55%

Saving

56%

Saving

© ARM 2016 19




Timeline

Binary model evaluation tool

Alpha available now

Beta release 14th December 2016

EAC release March 2017

Hardware

EAC release 14th December 2016

Firmware

EAC release March 2017

Software

ViDDK r4p0 EAC release April 2017

© ARM 2016 20




Text 30pt sentence case

Mali-V61 summary Providing state of the art codec support

~50% Bit-rate

savings

10-bit

4KUHD encode/decode

32MP Multi-shot at

20 FPS

10-bit

VP9 encode/decode

10-bit

HEVC encode/decode

The trademarks featured in this presentation are registered and/or unregistered trademarks of ARM Limited

(or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be

trademarks of their respective owners.

Copyright © 2016 ARM Limited

Confidential © ARM 2016

Thank you

introducing mali-v61 arm’s next generation mali video processor · 2016. 11. 4. · 3 © arm...

Documents