the economics of content...
TRANSCRIPT
![Page 1: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/1.jpg)
The Economics ofContent Delivery
Bruce Maggs
Duke UniversityEmerald Innovations
(and formerly Akamai Technologies)
![Page 2: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/2.jpg)
©2017 AKAMAI | FASTER FORWARDTM
In the beginning…
• Akamai deployed servers around the world and offered to deliver images that appeared on web pages.
• The goal was to speed up page load times• … and reduce infrastructure investment for
content providers.
![Page 3: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/3.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Impact of PLT on conversion for e-commerce web sites
Source: Akamai, State of Online Retail Performance, 2017 Holiday Perspective
![Page 4: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/4.jpg)
4
37Tbps
![Page 5: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/5.jpg)
Embedded Image Delivery
<html><head><title>Welcome to xyz.com!</title></head><body><img src=“<img src=“ <h1>Welcome to our Web site!</h1><a href=“page2.html”>Click here to enter</a></body></html>
http://www.xyz.com/logos/logo.gif”>http://www.xyz.com/jpgs/background.jpg”>
Embedded URLs are Converted to ARLs
ak
![Page 6: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/6.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Move to Full-Site Delivery88 of Alexa top 500 home pages delivered by Akamai
Motivated in part by split-TCP/TLS optimization
Motivated in part to protect web site
Akamai operates DNS for main domain, holds private keys!
persistent connection
fastestablishment alternative overlay path
origin serveredge server
client
![Page 7: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/7.jpg)
©2017 AKAMAI | FASTER FORWARDTM
The Akamai Platform and Services
Daily Statistics:• 80+ Tbps traffic served• 600+ million IPv4 addresses seen• 3+ trillion HTTP requests served• 260+ terabytes compressed logs
Delivering Content for 130,000+ Domains• All top 20 global ecommerce sites• All top 30 media & entertainment companies • 16 of the top 20 global banks• All major anti-virus software vendors
• 240,000+ Servers• 1,700+ Networks• 3,300+ Physical Locations• 750+ Cities• 130+ Countries
A Global Platform:
![Page 8: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/8.jpg)
![Page 9: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/9.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Flow of Payments
content provider
content delivery network
ISP colocation provider / IXP Hardware vendor
![Page 10: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/10.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Cost of Goods Sold (CoGS)
25% bandwidth (95/5 rule)25% colocation25% server depreciation (now over 4 years)25% other
colocation breakdown:40% rack space40% energy (now metered)20% other (e.g., interconnect within facility)
![Page 11: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/11.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Mapping Clients to Akamai Clusters
• Many “no brainers” – servers co-located with clients, e.g., on university campuses
• Otherwise, make decisions based on active measurements
![Page 12: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/12.jpg)
Wide Area Network Measurement
• Traceroute to all important name servers• Core point X is the first router at which all
paths to name servers 1, 2, 3, and 4 intersect.
• X can be viewed as the straddling the core and the edge of the network.
X
1 2 3 4
![Page 13: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/13.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Identifying Core Points
500,000 nameserversReduced to
30,000 core points
7,000 account for 95% end-user load
ping these continuously
![Page 14: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/14.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Bandwidth Breakdown
40% free from edge servers to clients40% paid from edge servers to clients20% from edge servers to origin servers
![Page 15: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/15.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Next Service: Streaming Media
• Proprietary servers and players Real, Windows Media, Quicktime, Flash
• UDP-based protocols• Network for live streaming built for Steve Jobs.
![Page 16: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/16.jpg)
clusters ofedge servers
Live Streaming Architecture
1 2 3 4
1 2 3 4x
1 2 3 4X X X X
1 2 3 4x
SatelliteDownlink
Entry Point
SatelliteUplink
Top-level reflectors
Encoding
1 2 3 4X
![Page 17: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/17.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Streaming Today
• Everything delivered over TCP/HTTP(S)• Client (typically JavaScript) makes all decisions• “Brokers” may choose from multiple CDNs• Vast majority of bytes served by CDN• Highly commoditized, low margin business
![Page 18: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/18.jpg)
©2017 AKAMAI | FASTER FORWARDTM
High Margin Services
Low latency content delivery
Bells & whistles (e.g., automatic A/B testing)
Protection from denial of service attacks
![Page 19: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/19.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Defending Web-Based Services from Attacks
Two Architectures:
Traditional CDN protects web sites
Packet filtering data centers provide generic protection for network-based services
![Page 20: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/20.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Distributed Denial of Service (DDOS) Attacks
The attacker hopes to overwhelm the content provider’s resources with requests for service.
Sometimes the attacker issues requests through a “bot army” of compromised or rented machines.
The attacker looks for “amplification” where an easy-to-generate request requires a large or difficult-to-generate response.
![Page 21: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/21.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Largest DDOS Attacks by Year
Gbps
Krebs
GitHub
0
200
400
600
800
1000
1200
1400
1600
20052006200720082009201020112012201320142015201620172018
![Page 22: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/22.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Origin Server
End User
1
10
100
10000
Origin Traffic
1000
Akamai Traffic
1
10
100
10000
1000
Akamai Kona Site Defender
![Page 23: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/23.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Malicious login attempts
![Page 24: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/24.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Origin Server
Prolexic IP Anycast Scrubbing Centers
128.2.205.42
128.2.205.42
128.2.205.42
128.2.205.42
128.2.205.42
![Page 25: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/25.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Moving Web Applications to the Edge
Standard three-tiered architecture
Web Server
App Server
DB
![Page 26: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/26.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Original CDN Application
Clients
Internet core
Content providers
CDN nodes
![Page 27: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/27.jpg)
©2017 AKAMAI | FASTER FORWARDTM
CDN Application Services
But… high latency to database server, and for data-intensive applications database server becomes the bottleneck.
DBUsers
Internet
Huge investment to support IBM WebSphere at edge
![Page 28: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/28.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Peer-to-Peer Assisted Content Delivery
Hybrid between a fixed-infrastructure CDN and a pure peer-to-peer delivery systemBased on technology developed by
Red Swoosh (acquired by Akamai in 2007)Goal is to deliver large files at lower cost
![Page 29: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/29.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Architecture
BitTorrent-like protocol with control nodes serving as “trackers” and assigning peersCDN acts as a backstop
Akamai Control Nodes Akamai Edge Servers
Peers
![Page 30: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/30.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Growth in Number of Installations
![Page 31: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/31.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Locations of Clients per EdgeScape
![Page 32: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/32.jpg)
©2017 AKAMAI | FASTER FORWARDTM
P2P Efficiency for Largest Enabled Customers
![Page 33: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/33.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Performance
Majority P2P downloads average several Mbps.
![Page 34: The Economics of Content Deliveryconferences.sigcomm.org/acm-icn/2020/assets/keynote-Bruce-Magg… · The Economics of Content Delivery Bruce Maggs Duke University Emerald Innovations](https://reader034.vdocuments.mx/reader034/viewer/2022052017/602f9b2a978f4b54de170ea9/html5/thumbnails/34.jpg)
©2017 AKAMAI | FASTER FORWARDTM
Implications for ICN
Incentives and costs must be aligned.
Performance benefits from caching:Reducing latency is valuable to content providers. Reducing network load is valuable to ISPs.
Caching in the core in addition to caching at the edge –how much additional benefit, and who pays?
Delivering everything over HTTPS/TLS makes traffic opaque, but recent history demonstrates that new protocols (e.g., QUIC) can be introduced.