cloud analytics for capacity planning and instant vm ... - ibm€¦ · cloud analytics for capacity...
TRANSCRIPT
![Page 1: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/1.jpg)
Cloud Analytics for Capacity Planning and Instant VM Provisioning
Yexi Jiang Florida International University
Advisor: Dr. Tao LiCollaborator: Dr. Charles Perng, Dr. Rong Chang
![Page 2: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/2.jpg)
Presentation Outline
• Background• Cloud Capacity Prediction
– Predict provisioning resource demand– Estimate de-provisioning requests– Experimental evaluation results
• Instant Cloud Provisioning– Predict VM provisioning demand– Experimental evaluation results
1 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 3: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/3.jpg)
Background
• What is Cloud Analytics? Rapidly identify cloud resource or application trouble spots so you can solve the problem.
• What is the objective of cloud analytics? • The cloud platform itself.
• What can cloud analytics do?– Workload analysis– System fault diagnostics– …
2 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 4: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/4.jpg)
Smart Cloud Enterprise trace data
• 5 month, 35k+ requests, 120+ image types, 20+ features each record• Important Features: Image Name, Owner, Start Time, End Time, ID
3 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 5: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/5.jpg)
Aggregating the Raw Data
5
weekly
daily
hourly
Cannot reflect real capacity
Just right
4 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 6: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/6.jpg)
Aggregating the Raw Data
Measurement Weekly Daily Hourly
Coefficient of Variance (CV) 0.5606 0.7915 1.2249
Skewness 0.3295 1.5644 5.4464
Kurtosis 1.62 5.8848 52.4103
6
weekly
daily
hourly
Cannot reflect real capacity
Just right
Too irregular
5 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 7: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/7.jpg)
Presentation Outline
• Background• Cloud Capacity Prediction
– Predict provisioning resource demand– Estimate de-provisioning requests– Experimental evaluation results
• Instant Cloud Provisioning– Predict VM provisioning demand– Experimental evaluation results
6 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 8: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/8.jpg)
Cost of Data Centers
• 31% of the cost is related to power.• As hardware price continuously decreases, the proportion would
further increase.• The US EPA estimates the energy usage at data centers is experiencing
successive doubling every five years. (7.4 billion in 2011)
* From James Hamilton's Blog
7 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 9: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/9.jpg)
Motivation
• Reduce power cost via capacity predictionCo
st o
f the
Clo
ud P
rovi
der
Prepared Resource
Real Requirement
8 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 10: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/10.jpg)
Motivation
• Reduce power cost via capacity predictionCo
st o
f the
Clo
ud P
rovi
der
Prepared Resource
Predicted Resource
Real Requirement
9 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 11: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/11.jpg)
Candidate Time Series
• Capacity time series– Non-stationary. – Difficult to model directly
• Provisioning /de-provisioning time series– Obvious temporal pattern– Better candidate
10 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 12: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/12.jpg)
Basic Idea
• Capacity = (# existing VMs) + (# provisioning) - (# de-provisioning)
Existing VM in cloud
-
+
PredictedProvisioning
PredictedDe-
provisioning
Predicted Capacity
11 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 13: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/13.jpg)
Predicting Provisioning Demands
• Ensemble method for time series prediction• Individual prediction techniques used:
– Moving Average. Naïve predictor.– Auto Regression. Linear predictor.– Neural Network. Non-linear predictor.– Gene Expression Programming. Genetic algorithm.– Support Vector Machine. Linear predictor with non-linear kernel.
• Dynamic weighted linear combination
• Weight update
wp(t) weight of predictor p
vp predicted value of individual predictor p
cp(t) cost of predictor p at time t
e(t) error of individual predictor p
12 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 14: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/14.jpg)
Cloud Prediction Cost
• Over-prediction: cost of resource waste. • R function:
• Under-prediction: cost of SLA penalty. • T function:
• Property: Non-negative, Monotonic.
13 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
))(~),(())(~),(( tvtvTtvtvRC +=
![Page 15: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/15.jpg)
Prediction Result
• Ensemble has the best average performance.
14 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 16: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/16.jpg)
Predicting De-provisioning
• Use the life span CDF F(x) of VMs to estimate number of de-provisioning requests
• Estimation of distribution: step-wise function.
* ni # of VMs with life span t (t1 < t < t2)
15 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 17: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/17.jpg)
De-provisioning evaluation
Test data: last 60 day. Test methods:1. No preparation at all (None)2. Always prepare the maximum capacity
(Maximum)3. Time series prediction (Time Series)4. Life span distribution despite of image
– 60 days of data (Dist 60)– 90 days of data (Dist 90)
• Global distribution estimation method outperforms the time series prediction method.
16 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 18: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/18.jpg)
Presentation Outline
• Background• Cloud Capacity Prediction
– Predict provisioning resource demand– Estimate de-provisioning requests– Experimental evaluation results
• Instant Cloud Provisioning– Predict VM provisioning demand– Experimental evaluation results
17 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 19: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/19.jpg)
Motivation
• Problem: Existing clouds are not “instant”, not suitable for mid-job scaling and urgent tasks.
• VM preparation is fast, but patching, security assurance, manual process and other processes cost time.
• Known solutions:– Prepare extreme large number of different types of VMs. Waste
resource– Ask customers to provide schedule. Impractical
• Our Idea: Make good use of the customer historical requests to infer the future demand. Reduce the average VM provisioning fulfillment time.
18 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 20: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/20.jpg)
Core Idea
Model and predict
demands
Predict Results
Pre-provisionat suitable
time
Wait for Requests
Assign VMs to
customers
19 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 21: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/21.jpg)
Focus on individual types
• No obvious temporal patterns for individual image type. Ensemble is still required.
20 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 22: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/22.jpg)
Focus on popular VM types
1) About 10% (12) of the 124 VM types consists more than 80% requests2) Inflection point divides the VM types into popular group and rare group 3) Requests for rare image types appear randomly.
21 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 23: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/23.jpg)
Workflow Overview
22 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 24: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/24.jpg)
Experimental Evaluation
• Ensemble method have the best performance in reducing waiting time and resource waste.
23 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 25: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/25.jpg)
Conclusion
• Capacity Prediction– The demand of cloud capacity can be estimated by predicting provisioning and de-
provisioning requests– Use time series ensemble method for provisioning prediction– Use VM life span model for de-provisioning prediction
• Instant cloud provisioning– Pre-provision VMs before requests arrive– Predict VM provision requests use time series ensemble method– The average provisioning fulfillment time can be reduced by 85%+
• Future work– Improve prediction with user profile– Fine-grain adjustment with control theory
24 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 26: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/26.jpg)
Thank you!
25 Yexi Jiang http://users.cis.fiu.edu/~yjian004/
![Page 27: Cloud Analytics for Capacity Planning and Instant VM ... - IBM€¦ · Cloud Analytics for Capacity Planning and Instant VM Provisioning Yexi Jiang . Florida International University](https://reader034.vdocuments.mx/reader034/viewer/2022042302/5ecd117e4f13196b5d02d7b3/html5/thumbnails/27.jpg)
Thank you
• Related Paper:• Intelligent Cloud Capacity Management. (NOMS 2012)• ASAP: A Self-Adaptive Prediction System for Instant Cloud
Resource Demand Provisioning. (ICDM 2011)
• Patent:• Cloud Provisioning Accelerator, Serial # 13306506, Pending
26 Yexi Jiang http://users.cis.fiu.edu/~yjian004/