cloudline autonomous driving solutions… · 2019-03-29 · cloudline autonomous driving solutions...

9
Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open design principles March, 2019

Upload: others

Post on 06-May-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open design principlesMarch, 2019

Page 2: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

The 4G / Edge Autonomous Vehicle Computing StackCurrent Generation: 4G and Cloud Data Centers

2

500 Miles / ~80ms Latency

Autonomous VehiclesA future with IoT at its center requires fast

computing solutions that current infrastructure

does not support. An autonomous car is said to

require approximately 4,000 gigabytes per

day. Mashable

The 4G NetworkThis is the current generation of

cellular networks that exist in the US

today

Cloud Data CentersNot suitable for the low latency real-time predictive

analytics autonomous vehicles will require. These could be

used to store the large amounts of un-structured data for

future data-mining and analytics. A car would have

traveled 4 feet with 80ms of data latency.

A car can travel 4 feetin the amount of time it takes

for data to travel round trip at

80ms latency

Page 3: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

The 5G / Edge Autonomous Vehicle Computing StackNext Generation: 5G and Micro Data Centers

3

5 Miles / ~5ms Latency

Autonomous VehiclesA future with IoT at its center requires fast

computing solutions that current infrastructure

does not support. An autonomous car is said to

require approximately 4,000 gigabytes per

day. Mashable

The 5G NetworkThe speed and latency requirements

of autonomous vehicles will require

5G technology. The carriers are

spending $100’s billions in order to

upgrade their infrastructure to handle

the 5G demand

Micro Data CentersWith autonomous vehicles constantly on the move a

requirement for data centers on the edge will evolve.

Companies like Vapor IO are designing self-enclosed micro

data centers that will be installed under cell towers.

A car can travel 4 inchesin the amount of time it takes

for data to travel round trip at

5ms latency

Page 4: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

HPE Cloudline Building Blocks for Big Data StreamingPurpose-built with Open Standards Based Hardware

4

“Data Lake”Object Storage- Warm/Cold

“Fast Data”Core Processing of data in motion

“Big Data”Analysis of data at rest

“IoT Event Producers”Edge Processing of data in motion

Different requirements along the data pipeline stages demand different node geometries

HPE Cloudline 2800

HPE Edgeline Products

HPE Cloudline 3100 with LFF HDDsHPE Cloudline 3100 with NVME

HPE Cloudline 5200 or 5800

Streaming

Analytics Storage

Streaming

Analytics Storage

Page 5: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

HPE Cloudline for Autonomous Driving Solutions

5

Kafka S3 ConnectorKafka Cluster

S3 Cloud Storage via Scality Ring

Data is serialized /converted to S3

IoT Events Producers

HPE Cloudline 5200/5800(S3 Data)

HPE Cloudline 2600(S3 Metadata)

HPE Cloudline 3100HPE Cloudline 3100HPE Cloudline 2800

Analytics

Messaging system for real time analysis of

streaming data

A distributed configuration &,

synchronization serviceSchema Registry

Avro-Schema-Connector

Kafka Data Stored in Avro formatZookeeper

Edge to Cloud

Data Ingest Object Storage

Processing 1.3M messages/sec 12B+ messages processed/serialized In 24 hours

107 operations/sec @1-1.5ms latency

Page 6: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

The SMACK Stack for Big Data / AI / ML

6

A fast, in-memory data

processing engine with

elegant and expressive

development APIs to allow

data workers to efficiently

execute streaming,

machine learning or SQL

workloads that require fast

iterative access to

datasets.

An open-source

stream processing

framework for

distributed, high-

performing, always-

available, and

accurate data

streaming

applications

A cluster manager

that provides efficient

resource isolation and

sharing across

distributed

applications or

frameworks

A set of open-source

libraries for designing

scalable, resilient

systems that span

processor cores and

networks

A distributed database

for managing large

amounts of structured

data across many

commodity servers,

while providing highly

available service and

no single point of

failure.

A fast, scalable, durable,

and fault-tolerant publish-

subscribe messaging

system. Kafka works in

combination with Apache

Storm, Apache HBase and

Apache Spark for real-time

analysis and rendering of

streaming data

An open source Apache project that provides centralized infrastructure and services that enable synchronization across a Hadoop cluster. ZooKeeper maintains common objects needed in large cluster environments. Examples of these objects include configuration information, hierarchical naming space, and so on. Applications leverage these services to coordinate distributed processing across large clusters.

Apache ZookeeperTM

Page 7: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

Autonomous Driving Software Eco-System (Example)

High Availability Configuration

Fronting Kafka Router

Cluster N

Cluster 1

Event Acquisitions

Pipeline

HPE Cloudline

Scality RING

Page 8: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

HPE Cloudline Portfolio

General Purpose Servers Compute Servers Storage Servers

HPE CL5200 Gen9

4U 2S, 80LFF

Very high density storage with

and ultra-low $/GB price point

HPE CL2800 Gen10

2U 2S, 24SFF or 12LFF or 16 NVMe

Expandable, open system in a 2U HPE flagship design

HPE CL2600 Gen10

1U 2S, 8SFF

The 1U open standard in an HPE

flagship design

HPE CL4100 Gen10

Dual NodesEach 1U 2S, 8SFF or 2 NVMe

Optimized for high-density compute and NFV workloads

HPE CL3100 Gen10

1U 2S, 12LFF or 20 NVMe

Cloud storage server for Hadoop, Casandra, real-time analytics

HPE CL5800 Gen9

4U 2S, 100LFF

Optimized for cloud storage

and big data workloads

Page 9: Cloudline Autonomous Driving Solutions… · 2019-03-29 · Cloudline Autonomous Driving Solutions Accelerating insights through a new generation of data and analytics using open

Thank you!For more information please visit us at OCP booth C6