internet scale architecture
DESCRIPTION
Cloud computing revolutionized application design, and changed the way people think about infrastructure. The rise of cloud computing coincided with a new generation of applications and services that required scale. New architecture and design had to take into account low latency network connectivity, geographic distribution, large real-time data stores, the ability to meet demand (while not knowing exactly how much demand to handle), and so much more. We refer to this as Internet Scale.Yet most discussion of scale and cloud revolves around compute as virtualized instances, which have defined configurations and constrained options. Delivering on the promise of Internet Scale involves substantial upfront design, and a comprehensive understanding of the entire architecture - from the underlying hardware, to the operating system, the application stack, services, and deployment. And, it involves choice - choices you should make based on your requirements. Join us for a discussion on the many facets of Internet Scale, and how it can apply to your applications and services.TRANSCRIPT
![Page 1: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/1.jpg)
Deliver on the Promise of Internet Scale Design and Architecture
Marc Jones, VP of Product Innovation
![Page 2: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/2.jpg)
![Page 3: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/3.jpg)
100k servers
24k customers
23million domains
![Page 4: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/4.jpg)
![Page 5: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/5.jpg)
![Page 6: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/6.jpg)
Defined user base
Global potential
Enterprise apps
Internet scale apps
Relative chaos
Relative predictability Cost
Revenue
![Page 7: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/7.jpg)
DefiningCloud Computing
Marketing termReference Architecture
Operations Model
Capacity on demandConsumption-based pricing
Self-service provisioningAccessible via API
![Page 8: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/8.jpg)
Internet Scale?
On-demand, elastic resources with 24×7 reliability.
Scale is resource availability and capacity.
Scale does not directly correlate to “faster” performance.
Scale can help provide predictable performance.
![Page 9: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/9.jpg)
51million blogs
57million daily posts
21billion blog posts
![Page 10: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/10.jpg)
50 million downloads
30 hrs drawings / sec
200 million dollars
![Page 11: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/11.jpg)
$0
$3,250.00
$6,500.00
$9,750.00
$13,000.00
Q1 08 Q2 08 Q3 08 Q4 08 Q1 09 Q2 09 Q3 09 Q4 09 Q1 10 Q2 10 Q3 10 Q4 10
seasonality
Online Retail
Net Sales (1,000,000’s)
![Page 12: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/12.jpg)
Does an SMB need Internet scale?
![Page 13: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/13.jpg)
0
25,000
50,000
75,000
100,000
JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC
promotional activity, social buzz
SMB
Monthly Unique Visitors
![Page 14: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/14.jpg)
Built forInternet Scale
Unpredictable tra!c patternsUnconstrained user baseGlobal potentialNetwork-sensitiveLeading-edge technology stack
![Page 15: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/15.jpg)
Workload characteristicsPerformance targetsControl requirementsAvailability mandates
ChoiceApplications dictate infrastructure
![Page 16: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/16.jpg)
Design + Architecture
![Page 17: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/17.jpg)
Design + Architecture
Why is scalability so hard? It can’t be an after-thought. It requires applications and platforms designed with scaling in mind.
Is achieving good scalability possible? Absolutely, but only if we architect and engineer our systems to take scalability into account.
Simply throwing additional CPU cycles or storage at an application is not going to deliver linear scalability unless the application was designed to scale in such a manner.
![Page 18: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/18.jpg)
Simplicity Over Complexity
Eliminate multi-step processes. Reduce each step of every process to its atoms. They perform their work in complete isolation, and communicate among one another with messages.
Think simple. If it is a complex problem, reduce to a simpler form. Iterate.
Simple is actually hard. You have to work to simplify.
“A system can be so simple that there are obviously no bugs, or it can be so complex that there are no obvious bugs.”
![Page 19: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/19.jpg)
Design + Architecture
Choose tools that can grow. The cloud makes it easy to add nodes. Does your software?
Choose tools that can shrink. The cloud makes it easy to remove nodes. Most software does not.
Leverage the best available to meet your requirements.
![Page 20: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/20.jpg)
Design + Architecture
Stateless and async. One of the guiding principles for linear scalability is to have lightweight, independent, stateless operations that can be executed anywhere and run on newly deployed threads/processes/cores/machines transparently as needed in order to service an increasing number of requests. Share nothing.
Testing async code can be non-trivial. Test coverage should be pursued early (as in at the start). Test early, test often.
![Page 21: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/21.jpg)
Bottlenecks
Eliminate choke points. Everything that has to be coordinated by a single machine, or even a single cluster, is a failure waiting to happen.
- Network
- StorageI/OArchitecture, design, and/or implementation flaws. Try to find them intentionally, not accidentally.
![Page 22: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/22.jpg)
Design + Architecture
Expect failure. Hosting infrastructure and the cloud are comprised of a lot of moving parts, each of which are prone to fail in their own way. Understand the potential failure points and architect your mission critical resources to survive.
![Page 23: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/23.jpg)
Connectivity
< 40ms
IPv6
10Gb
![Page 24: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/24.jpg)
Reach13 data centers
16 network POPs
20Gb fiber interconnects
![Page 25: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/25.jpg)
Singapore Dallas Amsterdam
Distributed
![Page 26: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/26.jpg)
Local Storage
![Page 27: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/27.jpg)
Network Storage
![Page 28: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/28.jpg)
![Page 29: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/29.jpg)
Inventory(You can’t deploy what doesn’t exist)
![Page 30: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/30.jpg)
Common network
API
Hybrid architectures
![Page 31: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/31.jpg)
Scale Up
![Page 32: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/32.jpg)
Scale Out
![Page 33: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/33.jpg)
Scale Down
![Page 34: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/34.jpg)
Unified image-based provisioning system
Move between virtual, physical
Clone/reload/snapshot physical servers
![Page 35: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/35.jpg)
TimeProvisioning speed
API feature set
Contract length
![Page 36: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/36.jpg)
Control
![Page 37: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/37.jpg)
Control
Better living through programmingIncrease agility
Reduce human error
Enable application autoscaling
Evaluate on scope, documentation, support & community
![Page 38: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/38.jpg)
Global deployments ! No capital expenditure ! Significant scale Consumptive billing ! Complete control
![Page 39: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/39.jpg)
Mature Easy-to-use GUI
Citrix-backed
RightScale compatible Flexible network architecture
Internet scale Open source platform
Why CloudPlatform?!
![Page 40: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/40.jpg)
Management Server!
ZONE 1!DATA CENTER 1!
Private VLAN!
Zones!
MULTIPLE OTHER ZONES!MULTIPLE DATA CENTERS!
Private VLAN!
One Management node supports one or more zones
VLAN !Spanning
![Page 41: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/41.jpg)
Management Server!
ZONE 1!DATA CENTER 1!
Clusters & Hosts!
Physical Host!
Guest VMs!
Physical Host!
Guest VMs!
Physical Host!
Guest VMs!
One or more clusters per zone, one or more hosts per cluster Cluster defined by storage
Local storage == single-server cluster
Cluster Cluster
![Page 42: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/42.jpg)
Management Server!
Hardware Options!Management Node Single Proc Quad Core Westmere, 6 GB DDR3 2x2TB SATA
Host Node Options Smallest: Dual Proc Quad Core Nehalem, 6-192GB DDR3 Biggest: Quad Processor 10 Core Westmere EX, 32-512GB DDR3 Storage: SATA, SA SCSI SSD
Network: 100Mb-10Gb line speed
Guest VMs! Guest VMs!
Host Node! Host Node!
![Page 43: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/43.jpg)
DEDICATED!HADOOP CLUSTER: DALLAS!
PRIVATE CLOUD!ZONE 2: SINGAPORE!
Physical Hosts!
Guest VMs!
Object Storage!Management Server! Object Storage!
Physical Hosts!
Guest VMs!
PRIVATE CLOUD!ZONE 1: DALLAS!
San Jose!
PUBLIC CLOUD WEB SERVERS!
Dallas! Singapore!
COMMAND & CONTROL!
![Page 44: Internet Scale Architecture](https://reader034.vdocuments.mx/reader034/viewer/2022052307/557811ccd8b42ab40c8b46c6/html5/thumbnails/44.jpg)