a cloud visitation platform for federated services at network edge

18
Dec 13, 11:00 GMT (20:00 Japan) http://conference.cisseconference.org/2014/live/

Upload: marat-zhanikeev

Post on 13-Jul-2015

191 views

Category:

Technology


2 download

TRANSCRIPT

Dec 13, 11:00 GMT (20:00 Japan) http://conference.cisseconference.org/2014/live/

.

Pre-Cloudization : The HomeBox Project• a hardware device for e2e probe networks 06

Coordinator

Bigger ISP

Bigger ISP

ISP Network

Outside Inside home

2 devices in 1 box

Home Box API

VLAN client

Packet capture

Local

Probe API

Home Box

Remote User or Service

Users

Probing

Linux OS

06 myself+0 "A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge" 1st COMPSAC/CDS (2013)M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 2/16

...

2/16

.

Cloudization of the HomeBox

1. active probing is just one of many services available at network edge◦ mobile clouds, hybrid clouds, client-side storage, and the recent fog computing

2. implemented as a cloud, the box reaches a reasonable limit of flexibility3. cloud-at-home with VMs/apps visiting over is neat idea in itself

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 3/16...

3/16

.

The Bigger (solved) Problems

1. finally make federated clouds a reality -- many users lined up 04

2. migration in heterogeneous environments -- environment sensing 05

3. more cloud at edges will help improve regional diversity of distributedresources 03

04 myself+0 "Multi-Source Stream Aggregation in the Cloud" Wiley (2014)

05 myself+0 "Optimizing Virtual Machine Migration for Energy-Efficient Clouds" IEICEJ, vol.E97-B, no.2 (2014)

03 K.He+5 "Next stop, the cloud: understanding modern web service deployment in EC2 and azure" IMC (2013)

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 4/16...

4/16

.

CVP: the Cloud Visitation Platform

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 5/16...

5/16

.

Cloud Visitation Platform (CVP) : 3-in-1

Location 1 Location 2 …

Cloud Management Platform(s)

Cloud APPs …

Tier 1

Tier 2

Tier 3

Cloud Visitation

Platforms

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 6/16...

6/16

.

CVP : The Definition.CVP..

.

... is a cloud platform that hosts VMs orAPPs and allows them access to local physicalresources

Location 1 Location 2 …

Cloud Management Platform(s)

Cloud APPs …

Tier 1

Tier 2

Tier 3

Cloud Visitation

Platforms

• conventional: no accessto local resources (black box)

• conventional: VMs/APPsnormally focus onover-the-networkaccess to resources

• CVP resources:sensors, storage, runningspace (room), ...

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 7/16...

7/16

.

CVP: the Design

Storage Sensors

Cloud Visitation Platform

Container

Cloud Visitation Platform

App App App …

APIs

Multitenancy

Physical Device

… Interfaces Billing,

Fairness

Generics, Resilience

Application Specifics

• the three traditional tiers

• multitenancy isoptional, can work withVMs directly

• each tier/level has itsspecific purpose (→next slides)

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 8/16...

8/16

.

CVP Tier 1: Hardware to Platform.Interfaces..

.

... are APIs to hardware functionality implementedby the cloud platform

Storage Sensors

Cloud Visitation Platform

Container

Cloud Visitation Platform

App App App …

APIs

Multitenancy

Physical Device

… Interfaces Billing,

Fairness

Generics, Resilience

Application Specifics

• accounting/billing, accessfairness, are the mainperformance targets

• generic API to allow forunique hardware environments

• ideally, a guy should be ableto install it at home (I use a USB

installer for my tests)

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 9/16...

9/16

.

CVP Tier 2: Platform to Container.APIs..

.

... are APIs that abstract the use oflower-level Interfaces

Storage Sensors

Cloud Visitation Platform

Container

Cloud Visitation Platform

App App App …

APIs

Multitenancy

Physical Device

… Interfaces Billing,

Fairness

Generics, Resilience

Application Specifics

• I currently use a modifiedversion of dokku 09 but thereare other choices

• resilience is key,containers/slugs/... arehard to debug or manageat runtime

09 "Example heroku-like framework (one of many)" https://github.com/progrium/dokku/ (2014)

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 10/16...

10/16

.

CVP Tier 3: Container to Apps

Storage Sensors

Cloud Visitation Platform

Container

Cloud Visitation Platform

App App App …

APIs

Multitenancy

Physical Device

… Interfaces Billing,

Fairness

Generics, Resilience

Application Specifics

• just normal VMs orapps

• use of APIs/Interfaces isoptional, traditionalapps will work as well

• NOTE: can bypasscontainers and haveVMs visiting over◦ grey boxes, etc. for

lighter migration bulk 05

05 myself+0 "Optimizing Virtual Machine Migration for Energy-Efficient Clouds" IEICEJ, vol.E97-B, no.2 (2014)

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 11/16...

11/16

.

CVP: Pull vs Push Deployment

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 12/16...

12/16

.

CVP: The PULL Deploy

Cloud Visitation Platform

App App App …

Pull-Based Installation (of Apps)

End User

Device Provider 3rd Party

Service

Local services

One Cloud

• better fir for physicalboxes where there is aprovider

• CVP sends regularrequests and pulls/installs apps on demand

• highly secure becauseprovider makes the box --closed network

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 13/16...

13/16

.

CVP: The PUSH Deploy

Cloud Visitation Platform

App App App …

Cloud/device Owner

3rd Party Service Federated

Clouds

Local services

Federated Cloud

Manager

• suitable for federatedclouds where 3-partytransactions are common

• VMs/apps are pushed

• still can be secure if eachcloud exposes an isolatedpart of its infrastructure

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 14/16...

14/16

.

Wrapup

• Cloud Visitation Platform is not a great but a very handy idea◦ not aware of any such platforms in existence today◦ in fact, the blackbox approach conflicts with the concept of visitation

• not hard to build but takes some work

• my current prototype (fully operational)

1. XCP 1.6 -- based on CentOS, use yum to enhance each XCP machine2. dokku for containers3. self-developed VM migration automation

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 15/16...

15/16

.

That’s all, thank you ...

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 16/16...

16/16

.

[01] myself+0 (2014)Coins in Cloud Drives Can Use OAuth for Micropayments and Resource MeteringAlikeCFI

[02] C.Kemp+1 (2013)Professional Heroku ProgrammingJohn Wiley and Sons

[03] K.He+5 (2013)Next stop, the cloud: understanding modern web service deployment in EC2 andazureIMC

[04] myself+0 (2014)Multi-Source Stream Aggregation in the CloudWiley

[05] myself+0 (2014)Optimizing Virtual Machine Migration for Energy-Efficient Clouds

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 16/16...

16/16

.

IEICEJ, vol.E97-B, no.2

[06] myself+0 (2013)A Home Gateway Box with Meter, Probe and L2 QoS Policy Edge1st COMPSAC/CDS

[07] (2008)Management of Performance Measurement for NGNITU-T Y.2173

[08] C.Dovrolis+3 (2010)Measurement Lab: Overview and an Invitation to the Research CommunityACM ComCom Review (30/4)

[09] (2014)Example heroku-like framework (one of many)https://github.com/progrium/dokku/

M.Zhanikeev -- [email protected] -- A Cloud Visitation Platform for Federated Services at Network Edge -- http://bit.do/marat141220 -- 16/16...

16/16