Deploying Digital Promotions with AWS

Download Deploying Digital Promotions with AWS

Post on 24-Sep-2014




1 download

Embed Size (px)


A case-study of using Amazon Web Services (AWS) to support Super Bowl-advertising Internet traffic


<p>Deploying Digital Promotions with AWSA case-study of using Amazon Web Services (AWS) to support Super Bowl-advertising Internet trafc</p> <p>Naming Conventions The names in this presentation have been The digital promotions company which The client represented within will beknown as Client Co. provided these services will be known as Promo Co. sanitized to protect trade-secrets, obscure company liability, and respect client NDAs</p> <p> The statistics and metrics within are real</p> <p>Wide-Angle Scope Promo Co. hired to provide a web-basedpromotion for a give-away</p> <p> Client Co. advertised the aforementionedgive-away during the 2010 Super Bowl</p> <p> In-house promotion infrastructure notbegins to hit web infrastructure</p> <p>easily scalable to elastically grow and shrink to needs of Super Bowl-generated trafc</p> <p> Impossible to know exact needs until trafc</p> <p>AWS Learning Curve Integrating Amazon Web Services offered Building &amp; deploying Amazon MachineImages (AMI) for VM deployment on EC2</p> <p> Managing regional congurations of AWS Implementing Elastic Load Balancer (ELB) Deploying promotion updates/patches toEC2 cluster</p> <p> Integration of EC2 hosts with DB backend</p> <p>AWS Offerings Used EC2 provides virtualization infrastructurebased on Xen platform</p> <p> ELB provides DNS-based load balancingcongurations for EC2 hosts</p> <p> SimpleDB provides non-relational datastore for generic data objects</p> <p> EBS provides persistent storage for anysort of data; mountable to one host</p> <p> S3 allows for bucket storage of EC2 AMIs</p> <p>EC2 Basics Virtualization using Xen infrastructure Deployments are in California (US West),Virginia (US East), and Ireland (EU West) deployments of AMI, ELB, S3, and EBS persistent storage; EBS xes that issue</p> <p> Separate regions require duplicate</p> <p> Instances of AMIs do not by default contain Shut down means killing the VM and losingnon-persistent data (e.g. data not on EBS)</p> <p>EC2 AMIs Special le-format used with AWS Xendeployment; specic to Amazon only</p> <p> Starts as a Linux lesystem image/partition Creation of AMI done using AWS tools Separated into parts, encrypted, anduploaded to Amazon S3 with a checksum to create VM instances for usage</p> <p> Registering an AMI will make it available</p> <p>Elastic Load Balancing Simple conguration to group EC2 hosts Intelligent load-balancing; will not directtrafc to EC2 hosts deemed unhealthy</p> <p> Provides conguration of min &amp; max</p> <p>instances to run in an auto-scaling fashion</p> <p> Able to provide request/latency metrics Unable to load-balance across regions Does not provide balancing-type options</p> <p>SimpleDB for CAPTCHA SimpleDB provides simplistic key/valuestorage rather than a complicated RDBMS centralized for availability to all instances behind a load balancer data is only available to the local region done to Promo Co.s backend servers</p> <p> CAPTCHA session storage needed to be As with other AWS offerings, SimpleDB Promotions actual database calls were</p> <p>Load Testing Promotion</p> <p> 3.7 million page views over ~45 minutes Peak of ~1800 page views/sec 99.3% successful requests (200, 206, 210)</p> <p>Infrastructure LayoutInternet Akamai CDN AWS West ELB AWS East ELB East EC2 Promo Co. Backend</p> <p>Backup</p> <p>West EC2</p> <p>Active</p> <p> Akamai provides caching of static content Promo Co. has its own RDBMS backend</p> <p>EC2 Promotion Instances Servers running CentOS 5.4, 32-bit All promotion logs sent to external syslog c1.medium, 1.7GB of RAM, 2 virtual cores Instances focuses on high CPU performanceService Nagios Munin rsync syslog Java Jetty Purpose Service monitoring/availability Metric performance baselining Promotion application deployment Remote logging of software output Promotion application service</p> <p>Promotion Results</p> <p>Page View per Second</p> <p> ~2500 page views/second peak ~4 million page views</p> <p>HTTP Response Codes</p> <p> ~94% of requests were handled ne</p> <p>404 Error Codes</p> <p> ~61,000 404 responses of 18M requests</p> <p>Usage StatisticsBandwidth Usage (GB)150 112.5 75 37.5 0 20 15 10 5 0</p> <p>Number of Requests in Millions</p> <p>Edge</p> <p>Midgress</p> <p>Origin</p> <p>2007</p> <p>2008</p> <p>2009</p> <p>Data represents 19:25 - 22:55</p> <p>Promotion Scaling Initial load balancer was for 20 instances An increase of 10 instances to ELB wasmade after trafc starting coming in</p> <p> Akamai off-set ~71% of bandwidth to EC2 3.32M/4.03M page views were19:00-20:00 Peaks: CPU at 63% ; Memory at 60% Never utilized backup ELB (West region)</p> <p>Implementation Failures SimpleDB wasnt able to appropriatelySimpleDB calls, breaking functionality handle our CAPTCHA implementation</p> <p> 503 error codes were returned to us from Eventually consistent reads brokeCAPTCHA due to not syncing properly</p> <p> CAPTCHA was disabled as a hot-x 1.1 million SimpleDB errors total Approximately 9 minutes of SDB errors</p> <p>Positives of AWS Promotion Conguration Able to handle load for 2,500 page views/second with 30 hosts behind one ELB</p> <p> Multiple EC2 regions allowed for hot-sites Integration of AWS offerings provided easyscalability for entire infrastructure and bandwidth</p> <p> Costs were as-needed for instance uptime Quality customer service for questions</p> <p>Negatives of AWS Promotion Conguration Must understand intricacies of offerings tofully take advantage of services and deploy a new AMI</p> <p> Slow process to create, package, upload, No scalability between regions of EC2 Different costs for West vs. East vs. Europe Tools for EC2 mostly command line driven;interfaces need knowledge to leverage</p> <p>SummaryThe Amazon Web Service (AWS) offerings provide a cohesive application of cloud technologies. Competitors such as RackSpace Cloud were unable to provide the customer service, uptime, nor customization that Amazon does. Promo Co. will be expanding their cloud offerings in the near future to host other promotions as well as company infrastructure in the could utilizing AWS. Further effort has since gone into more adequately understanding the exact functionalities and limitations of AWS services. This more thorough understanding of technologies (especially that of SimpleDB) is expected to provide an even better experience going forward.</p>


View more >