autoscaling best practices
DESCRIPTION
Talk presented at FOSDEM'14 about Autoscaling, general guidance of what autoscaling is and good practices and behavioursTRANSCRIPT
Autoscaling Best Practices FOSDEM’14
Marc Cluet DevOps & Automation Advisory Rackspace
http://www.flickr.com/photos/gozalewis/3422530465/
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Who am I?!Marc Cluet (@lynxman)
More than 16 years of experience as a SysAdmin Founding member of Juju and MAAS while at Canonical Leading a DevOps Engineering Team at Rackspace Likes DevOps, programming and long walks on the beach
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
What is Rackspace?!Founded in 1998 in San Antonio, TX by three guys that wanted to create a hosting company Home of Fanatical Support /o/ Second biggest Public Cloud in the world OpenStack Project co-founder
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
What is Autoscaling?!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
What is Autoscaling?!
WASTED! $$$!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
What is Autoscaling?!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
What is Autoscaling?!
The ability to automatically or semi-automatically scale up and down a group of servers based on computing or traffic demand by provisioning new services!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/fischerfotos/7419253200/
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Traffic Patterns!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Traffic Patterns!ON & OFF!
Analytics!Banks/Tax Agencies!Test environments!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Traffic Patterns!FAST GROWTH!
Events!Business Growth!Slashdot Effect!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Traffic Patterns!VARIABLE!
News & Media!Event Registrations!Rapid fire sales!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Traffic Patterns!CONSISTENT!
HR Application!Accounting/Finance!E-mail!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/maximalideal/3356408693/
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Methodologies!
Time Based!Reactive!
Predictive!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Time Based Autoscaling!
Load Balancer
Server Server
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Time Based Autoscaling!
Load Balancer
Server Server
9:00am!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Time Based Autoscaling!
Load Balancer
Server Server
Nov 1st!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Time Based Autoscaling!
Load Balancer
Server Server Server
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Time Based Autoscaling!GOOD FOR!
On & Off!Consistent!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Reactive Autoscaling!
Load Balancer
Server 60%
Server 60%
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Reactive Autoscaling!
Load Balancer
Server 80%
Server 80%
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Reactive Autoscaling!
Load Balancer
Server 60%
Server 60%
Server 40%
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Reactive Autoscaling!
Load Balancer
Server 30%
Server 30%
Server 30%
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Reactive Autoscaling!
Load Balancer
Server 45%
Server 45%
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Reactive Autoscaling!GOOD FOR!
Fast Growth!Variable!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Predictive Autoscaling!
Load Balancer
Server Server
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Predictive Autoscaling!
Load Balancer
Server Server
Forecasted!Traffic!+30%!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Predictive Autoscaling!
Load Balancer
Server Server Server
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Predictive Autoscaling!GOOD FOR!
Fast Growth!Variable!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/samuraislice/3309481048/
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Amazon Cloudformation!
Based on Scaling Groups!High/Low Watermark!Scheduled Events!Uses base image + CF!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Rackspace Autoscale!
Based on Scaling Groups!High/Low Watermark!Scheduled Events!Uses Gold Image!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Rightscale Autoscale!
Based on Scaling Groups!High/Low Watermark Quorum!Scheduled Events!Uses Rightscale scripts!$$$!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Heat!
Based on Templates!High/Low Watermark!Scheduled Events!Uses Heat Scripts!DSL Compatible with CF!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Scryer!
Based on AI!Predictive Fidelity model!Feeds AWS API!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Your own!!
Collect your metrics!!collectd, diamond, statsd!
Have a good metrics database!!whisper, rrd!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Autoscaling Tools!Your own!!
Write your own autoscaling code!!with message queues! :)!!attached to your code!!brain close to the centre of decision!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK http://www.flickr.com/photos/68751915@N05/6355318323/
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Taking the most of it!Beware of the Kraken!!
Autoscaling can be dangerous!Have min-max allocations!
http://www.flickr.com/photos/liquidnight/5992114196/
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Taking the most of it!Choose the right metrics!
Stay with basic metrics!!CPU, mem, I/O disk/net!
Review autoscaling strategy with metrics!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Taking the most of it!Choose your strategy!
Scale up early!Scale down slowly!Don’t apply the same strategy to all apps!
RACKSPACE® HOSTING | WWW.RACKSPACE.CO.UK
Taking the most of it!Phasing in and Phasing Out!
Have in mind time to availability!Have in mind also decommission time!Golden Images can help speed!
45 RACKSPACE® HOSTING | © RACKSPACE US, INC. | RACKSPACE® AND FANATICAL SUPPORT® ARE SERVICE MARKS OF RACKSPACE US, INC. REGISTERED IN THE UNITED STATES AND OTHER COUNTRIES. | WWW.RACKSPACE.CO.UK
RACKSPACE® HOSTING | 5 MILLINGTON ROAD | HAYES, UNITED KINGDOM UB3 4AZ UK SALES: +44 (0)20 8712 6507 | UK SUPPORT: 0800 988 0300 | WWW.RACKSPACE.CO.UK
@lynxman!
http://slideshare.net/lynxmanuk/!
http://www.rackspace.co.uk/technicalservices/ !
!