interconnection, bandwidth and datacenters
DESCRIPTION
Interconnection, Bandwidth and Datacenters. “Water, water everywhere - And not a drop to drink.”. Remco van Mook, Equinix SwiNOG, May 23. 2013. Remcos -MacBook-Pro: ~ remco $ whoami. Topics for Today. Interconnection Markets The Bandwidth Challenge Datacenters: Equinix ZH5. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/1.jpg)
Interconnection, Bandwidth and Datacenters
“Water, water everywhere -And not a drop to drink.”
Remco van Mook, EquinixSwiNOG, May 23. 2013
![Page 2: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/2.jpg)
Remcos-MacBook-Pro:~remco$ whoami
![Page 3: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/3.jpg)
Topics for Today
Interconnection Markets
The Bandwidth Challenge
Datacenters: Equinix ZH5
![Page 4: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/4.jpg)
NO, NOT JUST INTERNET EXCHANGES
Act 1: Interconnection Markets
![Page 5: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/5.jpg)
5
The Price of Bandwidth, in bulk, per MbpsWestern Europe, early-mid 2011
A EUR80 fiber cross connect:
Internet Exchange traffic:
Backbone traffic Western Europe:
Transatlantic traffic, wholesale:
Internet Transit, wholesale:
Internet Transit, retail
Broadband Internet, consumer:
National Ethernet service:
3G mobile data, national:
GSM voice call, national:
3G mobile data, roaming low:
3G mobile data, roaming high:
GSM voice call, roaming:
SMS Text Messages:
SMS Text Messages, roaming:
$0.01
$0.25*
$0.50
$1
$2
$15
$50
$180
$11,400
$483,840
$834,000
$3,127,500
$3,338,496
$210,000,000
$1,166,400,000
Carrier Pigeon: $2500 (est)Carrier Pigeon: $2500 (est)
![Page 6: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/6.jpg)
6
The New Price of Bandwidth, in bulk, per MbpsWestern Europe, mid 2012 (based on 10Gbps)
A EUR80 fiber cross connect:
Internet Exchange traffic EU:
Internet Exchange traffic US:
Backbone traffic Western Europe:
Transatlantic traffic, wholesale:
Internet Transit, wholesale:
$0.01
$0.18*
$0.35*
$0.15
$0.50
$0.65
Pain ahead!
![Page 7: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/7.jpg)
7
Definition time!
A Healthy Interconnection market
1.Has sufficient critical mass to be self-perpetuating
2.Has at least a regional significance
3.Minimizes duplication of effort
![Page 8: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/8.jpg)
8
3 Basic Motivators
Why does a network expand its footprint?
1.Increase Revenue2.Reduce Cost3.Improve Quality
These decisions are made:
1.For different reasons, 2.By different people, 3.In different parts of an organisation.
![Page 9: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/9.jpg)
9
No seriously, where?
![Page 10: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/10.jpg)
10
No seriously, where?Take Frankfurt, for example:
![Page 11: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/11.jpg)
11
No seriously, where?Or Amsterdam:
![Page 12: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/12.jpg)
12
Why does it work?
![Page 13: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/13.jpg)
13
Consolidated effort
You need:
1.Space, Power and Local Connectivity2.Local/National eyeballs3.Transport providers4.National and International Content5.Carriers6.Foreign eyeballs
To work TOGETHER to create a SINGLE interconnection zone
![Page 14: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/14.jpg)
Act 2: The Bandwidth Challenge
![Page 15: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/15.jpg)
15
Cisco’s VNI – All IP Traffic
![Page 16: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/16.jpg)
16
AMS-IX Traffic over a 20 year period(2015 based on a CAGR of 40% and mid-2012 data)
![Page 17: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/17.jpg)
17
Evolution of Networking Standards(Planned) release dates of IETF Ethernet standards
![Page 18: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/18.jpg)
18
Hmm, that looks familiar…
• Those lines look the same!
• Besides, I recognise that 100,1000,10000,100000 series from somewhere…
• Let’s see those charts again on a logarithmic scale!
![Page 19: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/19.jpg)
19
AMS-IX Traffic over a 20 year period(2015 based on a CAGR of 40% and mid-2012 data)
![Page 20: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/20.jpg)
20
Evolution of Networking Standards(Planned) release dates of IETF Ethernet standards
2017!
400000
![Page 21: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/21.jpg)
21
As long as equipment performance keeps up…We now move to Andy Bechtolsheim, presenting at NANOG 55
“There is a big gap between the processes that are used for networking chips and the ones used for state of the art CPUs.”
“ASIC designs are not on Moore’s Law.”
“There is basically a bottleneck around I/O.”
![Page 22: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/22.jpg)
22
Oh, snap.
To summarize, linear growth…
![Page 23: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/23.jpg)
23
Takeaways
Traffic keeps growing exponentially
Network hardware backplanes are not
We need to get creative to solve this
And rethink how we’re interconnecting the Internet
![Page 24: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/24.jpg)
24
Abridged history of Internet interconnection
1980s Hey, it works!Early 1990s Buy my pipes!Late 1990s Wanna Peer?Mid 2000s Mine’s bigger than yours, go away.Late 2000s I’ll build my own, then.Mid 2010s Why am I building this network again?
![Page 25: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/25.jpg)
25
“Why am I building this network again?”Eyeball Version
![Page 26: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/26.jpg)
26
“Why am I building this network again?”
Off-net is the new hotness!
For some content providers, over half of their traffic is served from inside eyeball networks, trending upwards…
It helps to create walled gardens!
This does not scale!
Content Version
![Page 27: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/27.jpg)
27
A short explanation of a “Walled Garden”(Adult language version)
![Page 28: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/28.jpg)
28
This does not scale!
• Instead of ~20 locations to interconnect worldwide, we’re looking at over 200 deployments close to eyeball networks
• It doesn’t even work for a lot of things (interactive content, cloud)
• This sets a huge barrier to entry
• There is not enough physical infrastructure to support this!
![Page 29: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/29.jpg)
Act 3: Equinix ZH5
![Page 30: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/30.jpg)
Switzerland. The Secure Heart of Europe. ZH5.
30
• 6.5 km Dark Fiber between ZH5 and ZH4 for the price of a Cross Connect
• Dual Site Strategy for CHF 120.- MRR connectivity costFacts & Figures
1.IBX+
2.Leed Gold Standard
3.ISO 9001 and ISO 27001
4.80+ carriers
5.6‘680 m2 colocation area
6.14 MVA power
7.Biggest IT Ecosystem in Switzerland
8.High carrier density, 80+ Carriers
9.Located in the economical and business center of Switzerland
10.Scalability - power and space wise
![Page 31: Interconnection, Bandwidth and Datacenters](https://reader035.vdocuments.mx/reader035/viewer/2022062301/56813b4c550346895da43b27/html5/thumbnails/31.jpg)
Equinix Switzerland – Datacenters.
31
City DC Space Opening
Zurich ZH1 540 m2 1998
ZH2 373 m2 2004
ZH3 230 m2 2006
ZH4 1100 m2 2010
ZH5 6680 m2 2013
Geneva GV1 2060 m2 2000
GV2 2500 m2 2009
• Established 1998 (Telehaus -> iXEurope -> Equinix)
• ISO 9001 and 27001 certified
• Redundancy of equipment N+1
• Carrier-neutral
Facilities