An Introduction to theMali “Egil” Video Processor

Roger Barker

Media Processing Group

© ARM 2016

2

Text 30pt sentence case

ARM® Mali™ Multimedia Suite

Current high performance configuration

appearing in handsets in 2016

Integrating multiple solutions for GPU, Video

and Display into Android™ is a challenge

New SoCs are in design featuring

Mali-T880, Mali-DP550 and Mali-V550

Mali-DP650 display processor launched January

2016

Mali Multimedia Suite – Better Together

© ARM 2016

3

Mali Video – ARM does Things Differently

What?

Codec analysis, hardware acceleration or software control?

Develop hardware IP to accelerate where appropriate

Add specialized dedicated controllers for management and more

Develop firmware IP to execute requisite codecs and functions

Add cores to provide scalability

Why?

Provides flexibility, enables multi-standard, scalable, flexible codecs

Enables simultaneous encode & decode of multiple streams

Enables a degree of tailoring for our more specialist Partners…

This approach delivers a unified video solution

© ARM 2016

4

Android driver –

source code

Firmware –

binaries

Hardware – RTL,

integration kit

Mali Video

Hardware: Fixed function blocks

Dedicated controllers

Control logic

Memory/register interface

Software:

Memory allocation

Scheduling

Power gating

Android Driver

Linux Kernel Driver

VP9 Profile 0

VP9 10-bit Profile 2

VP9 Profile 0

VP9 10-bit Profile 2

HEVC Main 10 High Tier

Register interface

Firmware:

Codec implementation

Error concealment

Display frame

reordering

Rate control

Communication

between cores

Host Communication

Decoder Binaries

HEVC Main 10 High Tier

H.264, H.263, MPEG4, MPEG2,

VC1, Real 8/9/10

JPEG

Encoder Binaries

HEVC Lite, H.264, H.263,

MPEG4, MPEG2, VC1,

Real 8/9/10

JPEG

Mali “Egil”

© ARM 2016

5

Founder Members

Amazon

ARM

Cisco

Google

Intel

Microsoft

Mozilla

Netflix

Nvidia

Alliance for Open Media

AOMediaVideo pursues a new,

patent royalty-free video codec

specification and open source

implementation based on the

contributions of Alliance members

and the broader developer

community

ARM is a Founding Member

© ARM 2016

6

Mali “Egil” Freedom of Use

Mali Video simultaneously encodes and decodes

Ideal for conferencing

Sharing what you see

Can use multiple codecs simultaneously

So you can still watch the game!

© ARM 2016

7

-

200

400

600

800

1,000

4K20 4K40 4K60 4K80 4K120

“Egil” 16FF @ 800MHz

Mali “Egil” Scalability

No. of

Cores

16FF @

800MHz

Typical

Displays

1 158Mpps 1080p80

2 316MppsWQHDp90

1080p160

3 475MppsWQXGAp120

4K UHDp60

6 949Mpps 4K UHDp120

I core 2 Core 3 core 4 Core 6 Core

Mpix/S

© ARM 2016

8

Mali “Egil” Focus on Encoding

VP9 encode available to mobile

High quality, 10-bit Profile 2 or 8-bit Profile 0 encoding

Reference Frame Scaling support for both Encode and Decode

HEVC

Add B-frames and 10-bit encode support

General improvements – apply to all encoders

Redesign of motion estimation engine

Finer granularity

© ARM 2016

9

Mali “Egil” Exceeds Premium Mobile Requirements

4K UHD 2160p VP9 encode in a flexible, scalable,

multi-standard IP block Adding a complete VP9 codec supporting VP9’s key

differentiators

Significantly improves encode quality and

performance for HEVC High-quality HEVC codec to Main 10 High Profile

Continues ARM’s delivery of IP optimized for

premium mobile use

The trademarks featured in this presentation are registered and/or unregistered trademarks of ARM Limited

(or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be

trademarks of their respective owners.

Copyright © 2016 ARM Limited

© ARM 2016

Thank you