cloudia: a deployment advisor for public clouds · • ibm ilog cp optimizer • intel core i7-2600...

1
ClouDiA: A Deployment Advisor for Public Clouds Tao Zou, Ronan Le Bras, Marcos Vaz Salles*, Alan Demers, Johannes Gehrke Cornell University, *University of Copenhagen (DIKU) Challenge: How to create a < logical graph, physical allocation> mapping to minimize longest link (path)? Simulation Search Aggregation Key-value Store Service Pipelines Longest Link Longest Path Allocate Instances Get Measurements Search Mapping Deployment Plan Terminate Extra Instances Communication Graph Objectives Start Application ClouDiA Public Cloud Tenant Heterogeneous Network Latencies in Public Clouds Physical Allocation vs. Logical Graph Non-contiguous allocation Heterogeneous pair-wise latencies …… Architecture of ClouDiA Measuring Network Distance Approximations: IP Distance / Hop Count Accurate Measuring: Uncoordinated / Staged Search Mapping Mixed-Integer Program and Constraint Programming for minimizing longest link Effect of Over-Allocation Overall Effectiveness 100 instances + 10%-50% over-allocation Get Measurements + Search Mapping < 10 minutes 10% over-allocation CP convergence with k-means CP solver scalability IBM ILOG CP Optimizer Intel Core i7-2600 + 16GB RAM

Upload: others

Post on 07-Aug-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: ClouDiA: A Deployment Advisor for Public Clouds · • IBM ILOG CP Optimizer • Intel Core i7-2600 + 16GB RAM . o o 0.8 0.6 0.4 0.2 50 100 Time[hours] Link 1 Link 2 Link 3 Link 4

ClouDiA: A Deployment Advisor for Public Clouds

Tao Zou, Ronan Le Bras, Marcos Vaz Salles*, Alan Demers, Johannes Gehrke

Cornell University, *University of Copenhagen (DIKU)

Challenge: How to create a < logical graph, physical allocation> mapping

to minimize longest link (path)?

Simulation

Search Aggregation

Key-value Store

Service Pipelines

Longest Link

Longest Path

Allocate Instances

Get Measurements

Search Mapping

Deployment Plan

Terminate Extra Instances

Communication Graph

Objectives

Start Application

ClouDiA Public Cloud Tenant

Heterogeneous Network Latencies in Public Clouds

Physical Allocation vs. Logical Graph

Non-contiguous allocation Heterogeneous pair-wise latencies

……

Architecture of ClouDiA

Measuring Network Distance

Approximations: IP Distance / Hop Count

Accurate Measuring: Uncoordinated / Staged

Search Mapping

Mixed-Integer Program and Constraint Programming for minimizing longest link

Effect of Over-Allocation Overall Effectiveness

• 100 instances + 10%-50% over-allocation • Get Measurements + Search Mapping < 10 minutes

• 10% over-allocation

CP convergence with k-means CP solver scalability

• IBM ILOG CP Optimizer

• Intel Core i7-2600 + 16GB RAM