roadmap for the cloud to edge infrastructure for a world

Copyright © 2018 Arm, All rights reserved.

#Arm Tech Symposia

Roadmap for the cloud to edge infrastructure for a world of 1T intelligent devicesBrian Jeff

Sr. Director, Product Management

Arm

2Copyright © 2018 Arm , All rights reserved.

Today’s compute model

Stream DownloadDistribute

Video IP content

(70% of Internet traffic)

Consume

Cloud Data Centers

Create& Distribute

Billionsof Devices


Compute model must change to manage 1T edge devices

Cloud Data Centers

1

TrillionDevices

Massive Amounts of Data


New compute/networking/storage/security architectures

1

TrillionAutonomousMachines & Smart Devices


N+S+SOffloadCPU GPU TPU

Cloud Data Centers


New distributed compute model

Critical Data

N+S+S OffloadCPU GPU TPU

Cloud Data Centers

Cloud Tiers N+S+S Offload

CPU GPU TPU

Edge Clouds

N+S+S Offload

CPU

Critical Data

Massive Amounts of DataLocal Decisions

5G

1


Analyze& Store

Filter

& React


New infrastructure to unleash the brilliance of 1T Arm devices

Critical Data

N+S+S OffloadCPU GPU TPU

Cloud Data Centers


CPU GPU TPU

Edge Clouds

N+S+S Offload

CPU

Critical Data


5G

1


The New Infrastructure Will Be Designed from the Edge In

© 2

01

8A

rm L

imit

ed

The Cloud to Edge Infrastructure Foundationfor a World of 1T Intelligent Devices

© 2

01

8A

rm L

imit

ed

High Performance, Secure IP and Architectures

Diverse Solutions and Ecosystem

Scalable from Hyperscale to the Edge


© 2

01

8A

rm L

imit

ed






Cloud ServerControl plane

ZeusPlatform

PoseidonPlatform

AresPlatform

Arm Neoverse IP roadmap – commitment to infrastructure

CosmosPlatform

Cortex-A72, A75

CMN-600

GIC, MMU

DDR4, 16nm

Zeus CPU

CMN,

GIC, MMU

DDR5, 7nm+

Poseidon CPU

CMN,

GIC, MMU

5nm

Ares CPU

CMN + CCIX

7nm

Silicon in

market2020 2021Today 2019


Arm Neoverse IP performance roadmap

AresPlatform

ZeusPlatform

PoseidonPlatform

CosmosPlatform

DDR4, 7nm

DDR5, 7nm+

5nm

2020 20212019Silicon in

marketToday


Secure platform software architecture

UEFI/EDK-II boot loader

Arm TrustZone Architecture - system-wide hardware isolation

Trusted firmware: PSCI, SMC, MM & SCMI

Operating System

Arm platform standards

User Applications

Industry standards

TCG, NIST,OCPEcosystem IP

Secure Arm Platform

Hypervisor

VM VM VM

Co

nta

ine

r

Co

nta

ine

r

Co

nta

ine

rArm ServerReady

test suite

Ecosystem security software

e.g. FW, boot-loader, BIOS

Neoverse CPU and System IP

CryptoIsland Secure Enclave

Trusted Execution

Environment (TEE)

LEGEND

Arm ecosystem

Compliance & standards

Arm open-source SW

Arm IP & Architecture

© 2

01

8A

rm L

imit

ed






Maximum efficiencyData plane

Cloud serverControl plane

ZeusPlatform

PoseidonPlatform

HeliosPlatform

AresPlatform

Diversity - Arm Neoverse IP

CosmosPlatform

Cortex-A55

Cortex-A72, A75

CMN-600

GIC, MMU

DDR4, 16nm

Zeus CPU

CMN,

GIC, MMU

DDR5, 7nm+

Poseidon CPU

CMN,

GIC, MMU

5nm

Ares CPU

CMN + CCIX

GIC, MMU

7nm

2020 20212019Silicon in

marketToday


Tiered acceleration:

Local cluster, global,

Off-chip

Configurable:

Diversity - broad SoC design options with Arm

Cache size, core count

SIMD width

Arm Architectural designArm IP

Custom Arm High performance CPUCustom Fabric & IP

Accelerators

High performance CPUs

Foundry

Memory

Data plane CPUs

IO

TSMC 7FF, Samsung 7LPP, UMC

CMN FabricOther IP

ML, on-die FPGA

Networking, security, encryption

Video, Custom

DDR, HBM, Flash, Storage Class memory

PCIe, CCIX, 100G+ ethernet

Common Software Platform and EcosystemArm Architecture v8.x-A

© 2

01

8A

rm L

imit

ed






Arm CPUs

128 big256 data plane

Bandwidth1 TB/s

System cache128MB

HBM8

DDR channels8

4

20 GB/s

0 MB

0

1

1ch DDR4

CMN 10G

RadioHelios CPUs

CMN

8ch DDR4PCIe 100GbE CCIX

Scalable IP system solutions from cloud to edge

Edge AccessN+S+S OffloadCPU GPU TPU

Cloud Data Centers


CPU GPU TPU

Edge Clouds

N+S+S Offload

CPU

5G


Scalable system

Scalable Mesh interconnect

Designed together with Arm CPUs

0, 8, 16,32,64, 128MB cache

4 to 64 home nodes

Agile: can include mapped memory

Sustained bandwidth to 1TB/s

CMN


Scalable system

100GbE

A72, Ares

2x4 mesh

8 to 16 high performance CPUs

Or 32 small CPUs – A55, Helios

2ch DDR4

CMN

PCIe CCIX


Custom Acceleration

Network+Storage+Security Offload

100GbE

A72, Ares

Scalable system

2x4 to 4x4 mesh

16~24 CPU

16+ MB system cache

2ch DDR4

RDMA

Packet Inspection

TCP/IP offload

De-duplication

Compression

NVMe-OF Offload

Crypto

IPSec

Secure Enclave

Storage Security

WorkloadsOVS, IPSec, RoCE, NFV, software defined network/storage, virtualization

Network

CMN

35~65W Power budget

PCIe CCIX

$3.5B revenue opportunity to cloud vendor


Custom Acceleration

Network+Storage+Security Offload

100GbE

A72, Ares

Scalable system

2x4 to 4x4 mesh

16~24 CPU

16+ MB system cache

2ch DDR4

RDMA

Packet Inspection

TCP/IP offload

De-duplication

Compression

NVMe-OF Offload

Crypto

IPSec

Secure Enclave

Storage Security

WorkloadsOVS, IPSec, RoCE, NFV, software defined network/storage, virtualization

Network

CMN

35~65W Power budget

PCIe CCIX

$3.5B revenue opportunity to cloud vendor16 vCPUs per server lost to management1M servers * 16 vCPUs * $220/core/year

Smart Offload


Cloud server

Arm enables more performance per socket48, 64, 96 Arm cores per socket

100~200W Power budget

Scalable system

8x8 1TB/s mesh

48, 64, 96 CPU

64MB system cachePCIe CCIXAres, Zeus

ML Accelerator

Flash, SCM

8ch DDR

CryptoIslandSecure Enclave Smart Offload

SecurityNetwork Storage

CMN

WorkloadsJava, NGINX, Docker, Kubernetes, DB, Hadoop, Ceph, etc.


Cloud server



Scalable system

8x8 1TB/s mesh

48, 64, 96 CPU

64MB system cachePCIe CCIXAres, ZeusCMN

ML Accelerator

Flash, SCM

8ch DDR

CryptoIsland

Server Compute Node

Smart Offload




Cloud server



Scalable system

8x8 1TB/s mesh

48, 64, 96 CPU

64MB system cache

Multi-socket


8ch DDR

PCIe CCIXAres, ZeusCMN

ML Accelerator

Flash, SCM

CCIX

CCIX

Server Compute Node 2

Server Compute Node 1

Smart Offload


CryptoIsland


5G wireless and edge access

1ch DDR4

CMN 10G

Radio

ML

Helios CPUsCryptoIslandSecure Enclave

Arm enables more performance at the far edgemicroMEC, RRH, DFE, DPU

<15W Power budget

Bulk crypto offload

Scalable system

2x2 or 2x4 mesh

16 to 32 high efficiency CPUs

A55, Helios

Workloads4G/5G baseband, wireline, edge gateway

© 2

01

8A

rm L

imit

ed

Endorsed by a robust ecosystem

Silicon Cloud Systems Operators

A M P E R E

Tencent Cloud

orange

© 2

01

8A

rm L

imit

ed

Endorsed by a broad and growing open networking and server ecosystem

Open SourceProjects Server& networking

Dev Tools &Resources

Container &Virtualization

Operating Systems

Language &Libraries


Trademark and copyright statementThe trademarks featured in this presentation are registered and/or unregistered trademarks of <COMPANY NAME> (or its subsidiaries) in the EU and/or elsewhere. All rights reserved. All other marks featured may be trademarks of their respective owners.

Copyright © 2018

Thank You!

30

roadmap for the cloud to edge infrastructure for a world

Documents