fog cloud caching at network edge via local hardware awareness spaces

via Local Hardware Awareness Spaces

Marat Zhanikeev [email protected] maratishe.github.io

2016/06/27@WEC@ICDCS@Nara

Fog Cloud Caching

PDF: bit.do/160627

at Network Edge

#LHAP #localhardware

#resourcediscovery

#caching #MiniCache

#fog #clouds #cdn

#networkedge

.

Cloudification and LHAP

M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 2/21...

2/21

.

LHAP : Terminology?


3/21

.

LHAP(1) Cloudification

WiFi

Scale/size of cloudified items

Timeline

Now (2016)

Probably should not cloudify

Should definitely cloudify Data

Centers Racks IoV > VC

Desktop

Notebook

APs, Beacons

Smartphone Sensor

IoT Delegated networking

Network core Network

edge


4/21

.

LHAP(2) Local Hardware Awareness

Local hardware

Xen (hypervisor)

Virtual Machine

User Apps

Physical Machine (PM)

Tools …

Virtual Machine

App

Tools

Global Network

HDD SSD

Control Layer

…

Virtual Machine

App

API Layer

Other local hardware

Resource Discovery

API Connection

Cloud

platform

Virtual

machines

Direct hardware access

Local Hardware Awareness Platform (LHAP)

• LHAP [la:p] : LocalHardware AwarenessPlatform 04

• API Layer: resourcediscovery, interfaces, APIsfor VMs/containers

• Control Layer:concurrency control,quotas, billing/accounting,etc.

04 M.Zhanikeev+0 "A Cloud Visitation Platform to Facilitate Cloud Federation and Fog Computing" IEEE Computer (2015)


5/21

.

LHAP(3) Push vs Pull Deploys• if same provider for box + service, then pull is suitable

• extremely heterogeneous, open federations should go for register/push

Cloud Visitation Platform

App App App …

Pull-Based Installation (of Apps)

End User

Device Provider 3rd Party

Service

Local services

One Cloud Cloud Visitation Platform

App App App …

Cloud/device Owner

3rd Party Service Federated

Clouds

Local services

Federated Cloud

Manager


6/21

.

LHAP(4) 3 Deploy Modes

1. 3rd party installs the neccesarytools and ships (migrates) theVM

2. VM comes bare, tools areinstalled locally

3. 3rd party selects from a localset of ready-made VM+tools options◦ good if you only want to run a

simple app, not needing a fullerenvironment (a greybox?) 10

10 F.Manco+2 "Towards the super fluid cloud" ACM SIGCOMM (2014)


7/21

.

LHAP(5) Feature Comparison

• MiniCache08 is the closest rival, but has many flaws by comparison

• LHAP offers several unique features, not found elsewhere

ResourceDiscovery

Multi-VM

Multi-PM

Generics (any

resource) Generics(VM type)

Impl . form

Load balancing (quota,

queue, etc.)

Traditional NO N/A N/A N/A N/A N/A N/A

MiniCache NO YES NO NO (storage only)

MiniOS only driver NO

LHAP (proposed) YES YES YES YES ANY Web

API YES

08 S.Kuenzer+3 "Towards minimalistic, virtualized content caches with minicache" 13th HotMiddlebox (2013)


8/21

.

LHAP(6) A "Simply Put" Taxonomy

CDN on Federated Clouds (proposal)

P4P, ISP-side Caching (static popular content)

Interactivity / Update frequency

Popularity M.Zhanikeev -- [email protected] Fog Cloud Caching at Network Edge via Local Hardware Awareness Spaces -- bit.do/160627 9/21

...

9/21

.

Modeling


10/21

.

Service Model (1) Detailed

CDN

Main

many

Manager

Storage Large

Federation, fog clouds VM

Cache 1 Cache 2

Manage content

CDN Traffic (End Users)

many

Cloud


11/21

.

Service Model (2) Simplified

many

Large/Core

Small/Fog Cloud(s) VM

Cache 1 Cache 2 many

Cloud Original Content

Scale (core to edge)

Local traffic

End Users

Network Provider

Replica (P4P, etc.)


12/21

.

Hotspot-y Input (1) Theory

0 20 40 60 80 100

Decreasing order

0

0.35

0.7

1.05

1.4

1.75

2.1

2.45

2.8

log(

val

ue)

Class AClass BClass CClass DClass E

• Hotspot Distribution 07:normal + popular + hot/flash items

• modeled as Dirichlet parallelstreams with Bread-Stick (BS)random unit

• key point : number of hotitems, since they causeFlash Events

07 M.Zhanikeev+1 "Popularity-Based Modeling of Flash Events in Synthetic Packet Traces" IEICE CQken (2012)


13/21

.

Hotspot-y Input (2) Actual Model

0 10 20 30 40 50Random order of items

0

0.4

0.8

1.2

1.6

2

2.4

2.8

3.2

3.6

log(

1 +

pop

ular

ity)

Hot stateFlash state


14/21

.

Caching Logic• common logic in CDN 02: keep only the top-N popular content• LHAP feature: the large Cache 2 range for for on-site (shared across VMs)

caching◦ lazy caching -- new content is downloaded by individual VMs (Cache 1) but end up

in Cache 2 as well

Popularity

Ordered list (decreasing popularity)

Cache 1 Cache 2 Main (remote) storage

02 S.Sivasubramanian+3 "Analysis of Caching and Replication Strategies for Web Applications" IEEE Internet Computing (2007)


15/21

.

Analysis


16/21

.

Results

0.04 0.08 0.12 0.16 0.2Cache 1 volume (ratio of total content)

3.85

3.95

4.05

4.15

4.25

4.35

4.45

log(

tran

sfer

cou

nt)

0.05/0.1 0.05/0.25 0.1/0.2 0.1/0.4 0.2/0.4 0.2/1.0

0

2

4

6

8

10

12

14

16

18

Ratio

of i

nner

/out

er fi

le tr

ansf

ers

Cache configuration (Cache 1 / Cache2 ratios)

3 * varianceband

Pre-saturation

Totalsaturation

Cache 1 at 0.1

TraditionalPerformance(Cache 2 does not exist)

Fog Caching Performance

Inner = outer line

• simple view : proposed methodnear-saturates at 0.1-to-0.2 ratio ofCaches 1-to-2

• vertical scales are different because theeffect is huge!


17/21

.

Wrapup : the Bigger Picture

• current LHAP prototypes are developed as an add-on on top of XCP1.6 (yum

helps with dependencies)

• working on in-VM APIs as a step towards Docker containers

Large Cloud

Small Cloud

Small Cloud

CDN Manager

CDN

Local clients • load balancing inheterogeneous clouds

• how heterogenous?how about smallstore-and-streamcloudlets running onwirelessly grouped carnavigators? (vehicular groupconnect in

other papers)


18/21

.

That’s all, thank you ...


19/21

.

LHAP vs MiniCache (details)

Local hardware

Virtual Machine

Cloud Platform (Xen)

App App App …

Multitenant

environment


Tools

API Layer Control Layer

Local Hardware Awareness Platform (LHAP)

…

Virtual Machine

App

Tools …

Virtual Machine

App Virtual Machine

App App App …

Global network (to Internet)

In-box network

…

MiniOS

App

SSD

Operating System

Virtual Machine

App App App …

Multitenancy impossible


Cloud Platform (Xen)

Operating System


HDD Local Network



Cloud Platform (Xen) Operating System

DtL: Direct to Local

Local hardware

SSD HDD


20/21

.

LHAP Boxes

• LHAP box feels equally at ease withresources on LAN and those runningon VMs within the box itself

• working on the beacon and WiFiDirect versions for IoT as well

Physical Device

LHAP

VM VM Con. Con. Con.

SWITCH OUT IN

Storage

Sensors

Hadoop Isolation

Non-CVP part

Physical Device

LHAP


HUB

WiFi

Wireless users

Wired users Wireless

AP

Storage

Sensors

…

WiFi

Wireless users

Wireless AP

Physical Device

LHAP


Storage

Sensors

…

Beacon

WiFi AP WiFi Client

P2P WiFi


21/21

fog cloud caching at network edge via local hardware awareness spaces

Technology