novel models and techniques for monitoring and analysis of software-defined elastic systems --...
DESCRIPTION
Presentation given in PhD Session of advanced School on Service Oriented Computing 30 June – 5 July, 2014, Hersonissos Crete Greece (http://www.summersoc.eu/program/) Contains in last slide embedded video of the given talk. Overview of techniques for analyzing elasticity of both cloud offered services and running cloud services, towards supporting the design, and control of elastic cloud services.TRANSCRIPT
![Page 1: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/1.jpg)
1
Novel Models and Techniques for Monitoring and Analysis of
Software-defined Elastic SystemsDaniel Moldovan
Distributed Systems Group, Vienna University of Technology
[email protected]://www.infosys.tuwien.ac.at/staff/dmoldovan/
SummerSoc 2014
![Page 2: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/2.jpg)
SummerSoc 2014 2
Agenda
• Analyzing Elasticity of cloud offered services• Quantifying elasticity of cloud offered services
• Monitoring elastic cloud services• Analyzing Elasticity of cloud services
• Elasticity Space, Boundaries and Pathway• Elasticity Dependencies
![Page 3: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/3.jpg)
Analyzing Elasticity of cloud offered servicesMotivation
SummerSoc 2014 3
What cloud offered service provides appropriate elasticity for me?
![Page 4: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/4.jpg)
Analyzing Elasticity of cloud offered servicesMotivation
Load balancer
Cost: /H & / GB
SummerSoc 2014 4
For non-elastic components easier to select service
![Page 5: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/5.jpg)
Analyzing Elasticity of cloud offered servicesMotivation
Load balancer ...
Cost: /H & / GB
?
SummerSoc 2014 5
What cloud offered service provides appropriate elasticity?
![Page 6: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/6.jpg)
Analyzing Elasticity of cloud offered servicesMotivation
Load balancer
t1.micro EBS+
...
Cost: /H & / GB
?
...
Cost: - OnDemand- Spot- Reserved (1/3 years)
Cost: /size/month
SummerSoc 2014 6
Should I select one service with higher Cost elasticity (more cost options), but with a mandatory dependency?
![Page 7: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/7.jpg)
Analyzing Elasticity of cloud offered servicesMotivation
Load balancer
t1.micro EBS+ i2.xlarge EBS+
...
Cost: /H & / GB
?
...
Cost: - OnDemand- Spot- Reserved (1/3 years)
Cost: /size/month
Cost: - OnDemand- Reserved (1/3 years)
Cost: /size/month
SummerSoc 2014 7
Should I go with a service with less Cost elasticity but an optional dependency on another service?
![Page 8: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/8.jpg)
Analyzing Elasticity of cloud offered services Approach
SummerSoc 2014 8
![Page 9: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/9.jpg)
Elasticity Capability Elasticity Dependencies
Service Unit
Analyzing Elasticity of cloud offered servicesModelling Elasticity Capabilities
Costm1.tiny
OnDemand
Reserved 1Y light
Spot
...SummerSoc 2014 9
![Page 10: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/10.jpg)
Analyzing Elasticity of cloud offered servicesCustomizable Elasticity Quantification Coefficients
• Elasticity Phase Quantification Coefficients
• Elasticity Dependency Type Quantification Coefficients
• Elasticity Dependency Volatility Quantification Coefficients
• Elasticity Capability Quantification Function
•
• Elasticity Quantification Function
SummerSoc 2014 10
![Page 11: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/11.jpg)
Analyzing Elasticity of cloud offered servicesExample: Elasticity of Amazon EC2 IaaS Services
SummerSoc 2014 11
• Elasticity Phase Quantification Coefficient
• Elasticity Dependency Volatility Quantification Coefficient
• Elasticity Dependency Type Quantification Coefficient
![Page 12: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/12.jpg)
SummerSoc 2014 12
Analyzing Elasticity of cloud offered services
![Page 13: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/13.jpg)
SummerSoc 2014 13
• Analyzing Elasticity of cloud offered services• Quantifying elasticity of cloud offered services
• Monitoring elastic cloud services• Analyzing Elasticity of cloud services
• Elasticity Space, Boundaries and Pathway• Elasticity Dependencies
![Page 14: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/14.jpg)
Monitoring elastic cloud servicesService Level Monitoring
Response time
Number of clients
Other specific metrics
System Level MonitoringGanglia, Nagios, etc.
CPU usage
Memory usage
Network transfer
14
User-Defined Requirements violation: - Cost per client too highReasons: - Too much logging? Monitoring chatter? - Too expensive VMs? Which one can be downsized? - Not enough clients? Why?
Controlling the service’s elasticity
SummerSoc 2014
Daniel Moldovan, Georgiana Copil, Hong-Linh Truong, Schahram Dustdar, MELA: Monitoring and Analyzing Elasticity of Cloud Services, 5'th International Conference on Cloud Computing, CloudCom. Bristol, UK, 2-5 December, 2013, http://dx.doi.org/10.1109/CloudCom.2013.18
![Page 15: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/15.jpg)
Monitoring elastic cloud servicesStructuring monitoring information
15
Monitoring Data
Service Structure
SummerSoc 2014
![Page 16: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/16.jpg)
Monitoring elastic cloud servicesStructuring monitoring information
16
Monitoring Data
Service Structure
Impose service structure over collected monitoring data
SummerSoc 2014
![Page 17: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/17.jpg)
Monitoring elastic cloud servicesStructuring and enriching monitoring information
17SummerSoc 2014
Compute number of used virtual machines per unit
![Page 18: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/18.jpg)
Monitoring elastic cloud servicesStructuring and enriching monitoring information
18SummerSoc 2014
Compute number of used virtual machines per unit
![Page 19: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/19.jpg)
Monitoring elastic cloud servicesStructuring and enriching monitoring information
19SummerSoc 2014
Enrich metric with COST information COST/VM * numberOfVMs
![Page 20: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/20.jpg)
Monitoring elastic cloud servicesStructuring and enriching monitoring information
20SummerSoc 2014
Propagate activeConnections from LoadBalancer service unit
![Page 21: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/21.jpg)
Monitoring elastic cloud servicesStructuring and enriching monitoring information
21SummerSoc 2014
Compute cost/client/h
![Page 22: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/22.jpg)
SummerSoc 2014 22
• Analyzing Elasticity of cloud offered services• Quantifying elasticity of cloud offered services
• Monitoring elastic cloud services• Analyzing Elasticity of cloud services
• Elasticity Space, Boundaries and Pathway• Elasticity Dependencies
![Page 23: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/23.jpg)
SummerSoc 2014 23
Data Controller
Event Processing
clientsLoad Balancer Data Node
Analyzing elasticity of cloud servicesMotivation
Elastic Service
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
Daniel Moldovan, Georgiana Copil, Hong-Linh Truong, Schahram Dustdar, MELA: Monitoring and Analyzing Elasticity of Cloud Services, 5'th International Conference on Cloud Computing, CloudCom. Bristol, UK, 2-5 December, 2013, http://dx.doi.org/10.1109/CloudCom.2013.18
![Page 24: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/24.jpg)
SummerSoc 2014 24
Data Controller
Event Processing
clientsLoad Balancer Data Node
Analyzing elasticity of cloud servicesMotivation
Elastic Service
• When to scale Event Processing? • Requirements for Event Processing?
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
Daniel Moldovan, Georgiana Copil, Hong-Linh Truong, Schahram Dustdar, MELA: Monitoring and Analyzing Elasticity of Cloud Services, 5'th International Conference on Cloud Computing, CloudCom. Bristol, UK, 2-5 December, 2013, http://dx.doi.org/10.1109/CloudCom.2013.18
![Page 25: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/25.jpg)
SummerSoc 2014 25
Data Controller
Event Processing
clientsLoad Balancer Data Node
Analyzing elasticity of cloud servicesMotivation
Elastic Service
• When to scale Event Processing? • Requirements for Event Processing?
• When to scale Data Node? • Requirements for Data Node?
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
Daniel Moldovan, Georgiana Copil, Hong-Linh Truong, Schahram Dustdar, MELA: Monitoring and Analyzing Elasticity of Cloud Services, 5'th International Conference on Cloud Computing, CloudCom. Bristol, UK, 2-5 December, 2013, http://dx.doi.org/10.1109/CloudCom.2013.18
![Page 26: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/26.jpg)
26
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
SummerSoc 2014
Analyzing elasticity of cloud servicesElasticity Space, Boundaries and Pathway
Daniel Moldovan, Georgiana Copil, Hong-Linh Truong, Schahram Dustdar, MELA: Monitoring and Analyzing Elasticity of Cloud Services, 5'th International Conference on Cloud Computing, CloudCom. Bristol, UK, 2-5 December, 2013, http://dx.doi.org/10.1109/CloudCom.2013.18
![Page 27: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/27.jpg)
27
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
SummerSoc 2014
Analyzing elasticity of cloud servicesElasticity Space, Boundaries and Pathway
Daniel Moldovan, Georgiana Copil, Hong-Linh Truong, Schahram Dustdar, MELA: Monitoring and Analyzing Elasticity of Cloud Services, 5'th International Conference on Cloud Computing, CloudCom. Bristol, UK, 2-5 December, 2013, http://dx.doi.org/10.1109/CloudCom.2013.18
![Page 28: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/28.jpg)
Elasticity Space Snapshot
Elasticity Space “Clients/h” Dimension
Elasticity Space “Response Time” Dimension
Analyzing elasticity of cloud servicesElasticity Space and Boundary
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
SummerSoc 2014 28
![Page 29: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/29.jpg)
Elasticity Space Snapshot
Elasticity Space “Clients/h” Dimension
Elasticity Space “Response Time” Dimension
Analyzing elasticity of cloud servicesElasticity Space and Boundary
User-Defined Elasticity Requirements
Cost <= 2.5 $/Month/Client Response Time <= 1 s
SummerSoc 2014 29
![Page 30: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/30.jpg)
Event Processing service unit Elasticity Pathway
Analyzing elasticity of cloud servicesElasticity Pathway
30SummerSoc 2014
![Page 31: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/31.jpg)
SummerSoc 2014 31
Agenda
• Analyzing Elasticity of cloud offered services• Quantifying elasticity of cloud offered services
• Monitoring elastic cloud services• Analyzing Elasticity of cloud services
• Elasticity Space, Boundaries and Pathway• Elasticity Dependencies
![Page 32: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/32.jpg)
Analyzing elasticity of cloud servicesElasticity Dependencies
32SummerSoc 2014
Enforce Elasticity Capability (scale in/our, reconfigure)
Effect ?
Change in Load
![Page 33: Novel Models and Techniques for Monitoring and Analysis of Software-defined Elastic Systems -- SummerSOC 2014](https://reader033.vdocuments.mx/reader033/viewer/2022060119/55906f151a28ab642f8b458b/html5/thumbnails/33.jpg)
Conclusions• Concepts
• Elasticity Space, Boundary, Pathway
• Elasticity Dependencies
• Elasticity Capabilities
• Mechanisms• Quantifying elasticity of cloud offered services
• Constructing cross-layer monitoring snapshots
• Analyzing elasticity
• Framework/Tools• QUELLE: a Framework for Accelerating the Development of Elastic Systems (
http://tuwiendsg.github.io/QUELLE)
• MELA: Monitoring and analyzing elasticity of cloud services (http://tuwiendsg.github.io/MELA/)
Work partially supported by the European Commission in terms of the CELAR FP7 project (http://www.celarcloud.eu/)
Distributed Systems Group (http://dsg.tuwien.ac.at/)
Vienna University of Technology (http://www.tuwien.ac.at/)
SummerSoc 2014 33