contrail virtual execution platform

24

Upload: netways

Post on 05-Dec-2014

1.976 views

Category:

Technology


2 download

DESCRIPTION

The Contrail Virtual Execution Platform (VEP) allows Cloud administrators to manage data centers and monitor the usage of resources. Users can manage their distributed applications on IaaS Cloud providers under the control of Service Level Agreements (SLA). VEP applications are packaged in the standard OVF format and they are deployed inside Constrained Execution Environments (CEE) derived from the SLA, to support the specification of SLA contracts between users and providers. These CEE environments allow to define constraints concerning virtual hardware performance, localization and affinity allowing the administrator to configure the monitoring system in order to feed external SLA enforcement services. VEP integrates elasticity management capabilities which can be controlled by external SLA enforcement services. A resource allocator service is integrated to dispatch the virtual components on the physical resources of the provider in accordance with the SLA terms. The first version of VEP is currently implemented on OpenNebula. This talk presents the implementation of VEP on OpenNebula and discusses some implementation choices such as the resource allocator.

TRANSCRIPT

Page 1: Contrail Virtual Execution Platform

Contrail Virtual Execution Platform

Yvon Jegou

September 25th 2013

Myriads Research TeamINRIA Rennes Bretagne-Atlantique

France

OpenNebula Conf 2013, 24-26 September in Berlin

Page 2: Contrail Virtual Execution Platform

Outline

Context: the Contrail project

Contrail Virtual Execution Platform

Service Level Agreements and derived execution environments

VEP and OpenNebula

Contrail VEP/1 contrail-project.eu

Page 3: Contrail Virtual Execution Platform

Context: Contrail ProjectOpen Computing Infrastructures for Elastic Services

Contrail project objectives

Development of an integrated approach to virtualization o�ering

services for federating IaaS clouds and PaaS services on top of

federated clouds

Challenges

Integration of resources from multiple IaaS providers

Trust, service level agreements (SLA)

Elasticity (pay-as-you-go)

Scalability

Portability, interoperability

Security

Contrail VEP/2 contrail-project.eu

Page 4: Contrail Virtual Execution Platform

VEP in the Contrail Software Stack

Contrail federation

SLA management

and enforcement

VEP: Virtual Execution Platform

IaaS

VEP: Virtual Execution Platform

VEP sits between the

infrastructure and higher-level

layers: federation and SLA

management

VEP provides a high level

interface for application

management on heterogeneous

providers

VEP integrates SLA support

Contrail VEP/3 contrail-project.eu

Page 5: Contrail Virtual Execution Platform

VEP in the Contrail Software Stack

Contrail federation

SLA management

and enforcement

VEP: Virtual Execution Platform

IaaS

VEP: Virtual Execution Platform

VEP sits between the

infrastructure and higher-level

layers: federation and SLA

management

VEP provides a high level

interface for application

management on heterogeneous

providers

VEP integrates SLA support

Contrail VEP/3 contrail-project.eu

Page 6: Contrail Virtual Execution Platform

VEP and Contrail Federation Layer

Contrail federation

SLA management

and enforcement

VEP: Virtual Execution Platform

IaaS

Each VEP is in charge of

managing applications on an

IaaS o�er on behalf of the

federation

Provides a high level uniformview of the infrastructure to thefederation

deploymentelasticity managementsnapshot

Participates to provider selection

by the federation

Monitors the application on the

infrastructure

Contrail VEP/4 contrail-project.eu

Page 7: Contrail Virtual Execution Platform

VEP and Contrail Federation Layer

Contrail federation

SLA management

and enforcement

VEP: Virtual Execution Platform

IaaS

Each VEP is in charge of

managing applications on an

IaaS o�er on behalf of the

federation

Provides a high level uniformview of the infrastructure to thefederation

deploymentelasticity managementsnapshot

Participates to provider selection

by the federation

Monitors the application on the

infrastructure

Contrail VEP/4 contrail-project.eu

Page 8: Contrail Virtual Execution Platform

VEP and Service Level Agreements

Contrail federation

SLA management

and enforcement

VEP: Virtual Execution Platform

IaaS

VEP provides support for SLA

negotiation: terms which can be

enforced, guarantees about

resource availability, ...

VEP allocates resources in-line

with agreed SLA terms

(localization, a�nity,

performance, ...)

VEP in charge of the monitoring

con�guration

Negotiated SLAs translated in

VEP using Constrained

Execution Environments

Contrail VEP/5 contrail-project.eu

Page 9: Contrail Virtual Execution Platform

VEP and Service Level Agreements

Contrail federation

SLA management

and enforcement

VEP: Virtual Execution Platform

IaaS

VEP provides support for SLA

negotiation: terms which can be

enforced, guarantees about

resource availability, ...

VEP allocates resources in-line

with agreed SLA terms

(localization, a�nity,

performance, ...)

VEP in charge of the monitoring

con�guration

Negotiated SLAs translated in

VEP using Constrained

Execution Environments

Contrail VEP/5 contrail-project.eu

Page 10: Contrail Virtual Execution Platform

VEP as an Independent Service

VEP can be exploited as an independent service

RESTful APIcan be exploited using a web browser

VEP manages applications as a whole

not just VMs

VEP application packaging: OVF format

OVF: Open Virtualization Format, a DMTF standardDistributed applications made of virtual machines (or containers),storage and networksOVF integrates

con�guration and deployment rules

means to contextualize virtual machines

VEP can exploit OVF application marketplaces

Contrail VEP/6 contrail-project.eu

Page 11: Contrail Virtual Execution Platform

VEP as an Independent Component (2)

Typical lifecycle of a VEP application

Virtual system disk image handling, external �lesApplication con�gurationExecution environment speci�cationResource need evaluationResource allocation (constraint-aware)ContextualizationDeploymentElasticity managementCheckpointing (potentially in OVF format)

Advance reservation of resources

Performance management and resource allocation constraints

VEP Constrained Execution Environments

Contrail VEP/7 contrail-project.eu

Page 12: Contrail Virtual Execution Platform

VEP as an Independent Component (2)

Typical lifecycle of a VEP application

Virtual system disk image handling, external �lesApplication con�gurationExecution environment speci�cationResource need evaluationResource allocation (constraint-aware)ContextualizationDeploymentElasticity managementCheckpointing (potentially in OVF format)

Advance reservation of resources

Performance management and resource allocation constraints

VEP Constrained Execution Environments

Contrail VEP/7 contrail-project.eu

Page 13: Contrail Virtual Execution Platform

CEE: Constrained Execution Environment

A CEE de�nes a virtual infrastructure integrating:

resource templates for computation, storage and networkingconstraints on resource allocation

localization

a�nity

protection, security

performance

OVF applications are deployed inside CEEs

OVF virtual resources mapped on CEE resource templates andallocated in accordance with associated constraints

CEE de�nition

Ready-to-use CEEs can be exported by IaaS providers

ie. A golden VM cluster with high performance interconnect

Users can de�nes their own CEEs

Contrail project: CEEs are derived from negotiated SLAs

Contrail VEP/8 contrail-project.eu

Page 14: Contrail Virtual Execution Platform

network

NFS server

mySQL server

load balancer

Apache server

net

NFS

mySQL

lbal

HTTP1

HTTP2

HTTP3

slot

slot

slot

slot

slot

slot

slot

L2net

largeVolume

smallVM

largeVM

sameCluster

10 Gb

CEE Constraints Resource Handlers

Virtual Resources OVF Descriptor

CEE handlers

VEP Application

Contrail VEP/9 contrail-project.eu

Page 15: Contrail Virtual Execution Platform

network

NFS server

mySQL server

load balancer

Apache server

net

NFS

mySQL

lbal

HTTP1

HTTP2

HTTP3

slot

slot

slot

slot

slot

slot

slot

L2net

largeVolume

smallVM

largeVM

sameCluster

10 Gb

CEE Constraints Resource Handlers

Virtual Resources

OVF Descriptor

CEE handlers

VEP Application

Contrail VEP/9 contrail-project.eu

Page 16: Contrail Virtual Execution Platform

network

NFS server

mySQL server

load balancer

Apache server

net

NFS

mySQL

lbal

HTTP1

HTTP2

HTTP3

slot

slot

slot

slot

slot

slot

slot

L2net

largeVolume

smallVM

largeVM

sameCluster

10 Gb

CEE Constraints Resource Handlers Virtual Resources OVF Descriptor

CEE handlers VEP Application

Contrail VEP/9 contrail-project.eu

Page 17: Contrail Virtual Execution Platform

network

NFS server

mySQL server

load balancer

Apache server

net

NFS

mySQL

lbal

HTTP1

HTTP2

HTTP3

slot

slot

slot

slot

slot

slot

slot

L2net

largeVolume

smallVM

largeVM

sameCluster

10 Gb

CEE Constraints Resource Handlers Virtual Resources OVF Descriptor

CEE handlers VEP Application

Contrail VEP/9 contrail-project.eu

Page 18: Contrail Virtual Execution Platform

VEP and OpenNebula

The current implementation of VEP in Contrail project targets

OpenNebula

From OVF description

disk sections ⇒ VM images

virtual systems ⇒ VM templates

product sections ⇒ contextualization

Resource allocation

VEP needs a constraint-aware resource allocatornot integrated to OpenNebuladeveloped as an external service

Monitoring

monitoring data for SLA enforcement and federation managementexternal monitoring service to export OpenNebula monitoring data

Contrail VEP/10 contrail-project.eu

Page 19: Contrail Virtual Execution Platform

Improvement Expected: VM Image Management

File references inside OVF disk sectionson the web

ie. OpenNebula marketplace

on image repositoryon IaaS image store

OVF supports disk delta

Application snapshots (in the future)

Need for close interaction with OpenNebula implementation to reduce

image management cost

Contrail VEP/11 contrail-project.eu

Page 20: Contrail Virtual Execution Platform

Contrail VEP and standards

OVF (Open Virtualization Format) from DMTF: applicationdescription

no extension to OVF

CIMI (Cloud Infrastructure Management Interface) from DMTF

VEP API based on CIMIFuture: VEP server interoperable with standard CIMI clients

In the future

OCCI (Open Cloud Computing Interface) from OGF

to support other IaaS o�ersEGI

CDMI (Cloud Data Management Interface) from SNIA

for image management

Contrail VEP/12 contrail-project.eu

Page 21: Contrail Virtual Execution Platform

Contrail VEP Software

First version May 2012

Current release (2.1): September 2013

integrating CEE supportRESTful API (DMTF CIMI style)

Full support of CIMI planned for the �nal release (2014)

VEP software: http://vep.gforge.inria.fr/index.php

Contrail VEP/13 contrail-project.eu

Page 22: Contrail Virtual Execution Platform

Conclusion

Contrail VEP provides means do deploy complex applications on

OpenNebula IaaS

Contrail VEP/14 contrail-project.eu

Page 23: Contrail Virtual Execution Platform

Consiglio Nazionale delle Ricerche Italia

Contrail)is)coordinated)by)Chris1ne)Morin,)INRIA,)France

Contrail VEP/15 contrail-project.eu

Page 24: Contrail Virtual Execution Platform

www.contrail-project.eu

Contrail is co-funded by the

EC 7th Framework Programme

Funded under: FP7 (Seventh Framework Programme)Area: Internet of Services, Software & Virtualization(ICT-2009.1.2)Project reference: 257438Total cost: 11,29 million EuroEU contribution: 8,3 million EuroExecution: From 2010-10-01 till 2013-09-30Duration: 36 months

Contract type: Collaborative project (generic)