Saurabh Jain

GIVING 5G NETWORKS THE EDGE IN SMART CITIES

2

AI AT THE EDGE IS A BIG OPPORTUNITY

5GIOT AI

3

5G CLOUD-NATIVE MOBILE EDGE RUNS MANY WORKLOADS

VNF

5G vRAN

CLOUD NATIVE

AI

AR/VR

Gaming

OFF THE SHELF SERVERS

WITH GPUS (COTS)

4

MANAGEMENTCLOUD NATIVE SECURITY

Continuous improvement and deployment

from cloud/data center to edge

Software and model deployment,

management and orchestration at scale

Enforce trust for every element

of the stack

CLOUD

DATA CENTER EDGE

CLOUD

EDGE

DATA CENTER

CLOUD DATA CENTER EDGE

THE CHALLENGE WITH AI AT THE EDGE

5

NVIDIA EGX PLATFORM

APPLICATION FRAMEWORKS AND SDKs

NVIDIA EGX STACK

NGC SOFTWARE ECOSYSTEM PARTNER

Kubernetes Containers CUDA-X IoT Runtime

NVIDIA EGX SERVER

GPU | AI | STORAGE NETWORKING | SECURITY

6

IOT SENSORS AND PIXELS TO INSIGHTS FOR EFFICIENCY

Access Control Public Transit Industrial Inspection Traffic Engineering

Retail Analytics Logistics Critical Infrastructure Public Safety

7

8

METROPOLIS FOR SMART CITIES

NVIDIA EDGE STACK

Kubernetes Containers CUDA-X IoT Runtime

METROPOLIS EGX APPLICATION FRAMEWORK

Sensor/Camera

Management

& Aggregation

Deepstream

RT AnalyticsSmart Indexing

& StorageRules

Engine

Visualization

Toolkit

NVIDIA EGX SERVER

GPU | AI | STORAGE NETWORKING | SECURITY

SOFTWARE APPLICATIONS

9

CERTIFIED APPLICATIONS

Software Vendors EGX Servers NVIDIA Profiling Tools Application Certification

System Sizing Guide

NGC Ready Application Helm and Docker

Performance & Utilization Data

10

AVAILABLE ON NGC

11

APPLICATION EXAMPLES FOR EDGE DEPLOYMENT

Self check-out in retailBusiness intelligence

Operations and logistics

12

NVIDIA METROPOLIS ISV PARTNERS

13

START DEPLOYING WITH NVIDIA EGX AND METROPOLIS

EXPLORE METROPOLIS | EXPLORE EGX | METROPOLIS SOFTWARE PARTNERS

14

15

SENSORS TO INSIGHT WITH EDGE AI

16

LEGACY APPROACH TO WIRELESSDedicated hardware for every function

DEDICATED FIXED-FUNCTION SYSTEMS

4G RAN

17

18

NVIDIA EGX BENEFITS

Largest domain of AI models

High throughput & low latency

One architecture scalable from device to cloud

NVIDIA is the Industry’s Most

Advanced AI Computing Platform

Hardware & software optimized for AI, storage, networking & security

Easy development & deployment of AI at edge

Optimized AI frameworks in NGC

NVIDIA EGX is AI-Optimized

for Industry Use Cases

Support for every platform — VMW, RH, NTNX, Azure, AWS, GCP

Rich 3rd party ISV ecosystem

Rich OEM & integrator ecosystem

NVIDIA is an

Open Platform

Every cloud

Hybrid cloud

Every system maker

Edge-to-data center-to-cloud

NVIDIA has a Pervasive

AI Platform

End-to-end, from development to deployment, from tools to experts

NVIDIA Research

DLI to reskill talent

SA & DevTech to co-engineer

NVIDIA has

Deep AI Expertise

Expertise in large verticals — M&E, healthcare, retail, manufacturing, transportation, & more

BD, SA, DevRel, DevTech, Research in every region

NVIDIA has Global Reach

and Support

19

Restarts containers that fail, replaces

and reschedules when nodes die

Scale your application up and down

with a simple command, with a UI, or

automatically based on usage.

Kubernetes builds upon 15 years of

experience of running production

workloads at Google, combined with

best-of-breed ideas and practices

from the community

AUTO SCALINGSELF-HEALING INDUSTRY STANDARD

Kubernetes for Cloud Native

20

Simplifies Deployments

• Easily deploy complex applications in one step

• Simple rollbacks

- Shareable through a local or cloud registry

Templated for Scalability

- Deploy many copies of an application without conflicts

- Deploy to multiple locations with a single command

Consistent CI/CD Integration

• Helm charts easily set up consistent environments for CI/CD pipelines

NGC HELM: ACCELERATING DEPLOYMENTS

Helm Registry

- Publish or share helm charts privately for inclusion in CI/CD

Curated ISV Software

• Readily deploy secured, GPU-optimized AI software

21

THE MOST POWERFUL TECHNOLOGY FORCE OF OUR TIME

AI COMPUTING

AI CLOUD

AI EDGE

AI ROBOTICS

22

AI COMPUTING

AI CLOUD

AI EDGE

AI ROBOTICS

23NVIDIA CONFIDENTIAL. DO NOT DISTRIBUTE.

METROPOLIS VIRTUAL PLATFORM

GPU SERVER

METROPOLIS APPLICATION FRAMEWORKAPPLIC

ATIO

NS

WIDE RANGE OF INDUSTRIES & USE-CASES

NVDOCKER KUBERNETES DEEPSTREAM CUDAVIDEO STREAM

MANAGEMENTMETADATA HUB

Frictionless

access controlSecuring

infrastructure Smart parkingLoss

prevention &

checkout

Crowd

analytics &

management

Operations and

logistics

Intelligent

traffic systems

24

Metropolis egx open Ai city platform

NVIDIA EDGE STACK

Kubernetes Containers CUDA-X IoT Runtime

METROPOLIS EGX APPLICATION FRAMEWORK

GPU | AI | STORAGE | NETWORKING | SECURITY

NVIDIA EGX EDGE COMPUTING PLATFORM

Sensor/Camera

Management

& Aggregation

Deepstream

RT AnalyticsSmart Indexing

& StorageRules

Engine

Visualization

Toolkit

25

CLOUD-NATIVE INSTALLATIONS

BIGDATA

NVIDIA DGX/HGX

NVIDIA EGX

METROPOLIS

NGC

RAPIDS

NVIDIA DGX/HGX MELLANOX

CUML

CUGRAPH

CUDNN

GPU DIRECT

CUIO

CUDF

NVIDIA AI

DEPLOY

MANAGE

IOT

26

Metropolis egx open Ai city platform

NVIDIA EDGE STACK

Kubernetes Containers CUDA-X IoT Runtime

METROPOLIS EGX APPLICATION FRAMEWORK

Sensor/Camera

Management

& Aggregation

Deepstream

RT AnalyticsSmart Indexing

& StorageRules

Engine

Visualization

Toolkit

NVIDIA EGX SERVER

GPU | AI | STORAGE NETWORKING | SECURITY

27

$2T 1B+ 250M 30MMarket Sensors &

CamerasHours Spent Reviewing

Video Every YearEdge Appliances Sold Every Year

SMART city OPPORTUNITY