nete4631 managing the cloud and capacity planning
DESCRIPTION
NETE4631 Managing the Cloud and Capacity Planning. Lecture Notes #8. Lecture Outline. Managing the cloud Administrating the cloud Managing responsibilities Lifecycle management Emerging cloud management standards Capacity Planning Steps for capacity planner Scenario Load testing - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/1.jpg)
1
NETE4631Managing the Cloud
and Capacity Planning
Lecture Notes #8
![Page 2: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/2.jpg)
Lecture Outline Managing the cloud
Administrating the cloud Managing responsibilities Lifecycle management Emerging cloud management standards
Capacity Planning Steps for capacity planner Scenario Load testing Resource ceiling Scaling
2
![Page 3: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/3.jpg)
Administrating the Cloud
Network management systems are often described as FCAPS (ISO) Fault/ Configuration/ Accounting/
Performance/ Security Fundamental features
Administrating/ Configuring / Provisioning of resources, Enforcing security policy, monitoring operations, Optimizing performance, Policy management, Performance maintenance, etc.
3
![Page 4: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/4.jpg)
Administrating the Cloud (2)
Network management framework tools BMC ProactiveNet Performance
Management HP OpenView/ HP manager products IBM Tivoli Service Automation
Manager CA (Computer Associates) Unicenter Microsoft System Center
4
![Page 5: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/5.jpg)
Administrating the Cloud (3)
5
![Page 6: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/6.jpg)
Management Responsibilities
What is different from traditional network management? Cloudy characteristics
Billing is on a pay-as-you-go basis. The management service is extremely scalable. The management service is ubiquitous. Communication between the cloud and other
systems uses cloud networking standards. The type of Cloud affects which tools for
monitoring Level of controlling aspects of operations –
IaaS>PaaS>SaaS
6
![Page 7: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/7.jpg)
Management Responsibilities by service model types
7
![Page 8: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/8.jpg)
What to be Monitored for Cloud?
End-users services such as HTTP, TCP, POP3/ SMTP, etc.
Browser performance on the client Application monitoring in the cloud such as
Apache, MySQL, and so on Cloud infrastructure monitoring of services
such as Amazon Web Services Machine instance monitoring where the
service measures processor utilization, memory usage, disk consumption, queue lengths, etc.
8
![Page 9: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/9.jpg)
Lifecycle Management
Six different stages in the lifecycle The definition of the services as a template for
creating instances Client interactions with the service, usually through
an SLA (Service Level Agreement) The deployment of an instance to the cloud and
the runtime management of instances The definition of the attributes of the service while
in operation and performance of modification of properties
Management of the operation of instance and routine maintenance
Retirement of service
9
![Page 10: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/10.jpg)
Cloud Management Products
Very young industry List of products -> Chapter 11 of Course Book
Core management features Support of different cloud types Creation and provisioning of different types of
cloud resources such as machine instances, storage, or staged applications
Performance reporting including availability and uptime, response time, resource quota usage
The creation of dashboards that can be customized for a particular client’s needs
10
![Page 11: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/11.jpg)
Example - CloudKick
www.cloudclick.com 11
![Page 12: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/12.jpg)
12
Emerging Cloud Management Standards
Distributes Management Task Force (DMTF) An industry organization that develops
industry system management standards for platform interoperability
Create a working group to help develop interoperability standards for managing transactions between and in public, private, and hybrid cloud systems
Describing resource management and security protocols, packaging methods and network management technologies.
![Page 13: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/13.jpg)
Distributes Management Task Force (DMTF)
13
![Page 14: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/14.jpg)
14
Emerging Cloud Management Standards (2)
Cloud Commons Initiated by CA and donates to Software
Engineering Institute (SEI), CMU, USA Establishes cloud-based metrics for
file creation and deletion/ Email availability/ console response time/ storage and database benchmark
Using dashboard called CloudSensor to monitor cloud-based services in real time
![Page 15: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/15.jpg)
Cloud Commons
15
![Page 16: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/16.jpg)
Capacity Planning
Capacity Planning Match demand to available resources Identify critical resources that has
resource ceiling and add more resources to remove the bottleneck of higher demands
Not focus on performance tuning or optimization
16
![Page 17: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/17.jpg)
Steps for Capacity Planner
Iterative process with the following steps Examine what systems are in place (characteristics) Measuring their workload for the different resources in
the system: CPU, RAM, disk, network and so forth Load the system until it is overloaded, determine when
it breaks, and specify what is required to maintain acceptable performance/ what factors are responsible for the failure (resource ceiling)
Determining usage pattern & predict future demand Add or tear down resources to meet demand
17
![Page 18: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/18.jpg)
Scenario
Example (LAMP) Capacity planner
works with a system that has a website on Apache
Also, a site has been processing database transactions (MySQL)
Application-level metrics
Page views (hits/s) Transactions (trans/s)
18
![Page 19: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/19.jpg)
Scenario (2) System-level metrics
What each system is capable of How resources of such a system affect
system-level performance Example
A machine instance (physical or virtual) CPU Memory (RAM) Disk Network Connectivity
Measured by tools such as sar command/ Microsoft task manager/ RRDTool for Linux
19
![Page 20: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/20.jpg)
RRDTool
20
![Page 21: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/21.jpg)
Load Testing Load testing seeks to answer the following question.
What is the maximum load that my current system can support?
Which resources represent the bottleneck in the current system that limits the system’s performance? (resource ceiling)
Can I alter the configuration of my server in order to increase capacity?
How does this server’s performance relate to your other servers that might have different characteristics.
Tools HTTPerf, Siege, Autobench, IBM Rational Performance Tester,
HP LodeRunner, Jmeter, OpenSTA
21
![Page 22: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/22.jpg)
Resource Ceiling (1)
22
![Page 23: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/23.jpg)
Resources Ceiling (2)
23
![Page 24: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/24.jpg)
Network Capacity Three aspects to assessing network
capacity Network traffic to and from the network
interface at the server (physical or virtual) system utilities (I/O), Network monitor (traffic)
Network traffic from the cloud to the network interface
Tools such as those from Apparel Networks Network traffic from the cloud through your
ISP to your local network interface The connection from the backbone to your
computer (through ISP)
24
![Page 25: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/25.jpg)
Scaling
Scale vertically (scale up) Add resources to a system to make it powerful A virtual system can run more virtual
machines (operating system instance), more RAM, faster compute times
Example – rendering or memory-limited apps Scale horizontally (scale out)
Add more nodes to remove I/O bottleneck Easy to pull resources and partition Example – web server apps
25
![Page 26: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/26.jpg)
26
Scaling Comparison Cost
Scale up pays more than scale out. Maintenance
Scale out increases the number of systems you must manage.
Communication Scale out increases the number of
communication between systems. Scale out introduces additional latency
to your system.
![Page 27: NETE4631 Managing the Cloud and Capacity Planning](https://reader035.vdocuments.mx/reader035/viewer/2022062808/568152bd550346895dc0df26/html5/thumbnails/27.jpg)
References
Chapter 6, 11 of Course Book: Cloud Computing Bible, 2011, Wiley Publishing Inc.
27