delivering the music in 265 milliseconds*d36cz9buwru1tt.cloudfront.net/.../aws_spotify...2.pdf ·...
TRANSCRIPT
Delivering the Music in 265 Milliseconds*
*Mean average playback
Don’t make me wait for my music!
Spotify in 60 Seconds (mean average)
Online music service with more
than 15 million tracks on
demand using unique
technology.
Freemium model (subscription
and ad-supported).
The largest music subscription
service of our kind.
Spotify in 60 Seconds (mean average)
• Founded: 2006 by Daniel Ek and Martin Lorentzon.
• Location: Available in 8 countries: USA, UK, Sweden,
Norway, Finland, The Netherlands, Spain and France
• Number of tracks: Over 15,000,000
• Registered users: Over 10,000,000
• Paying users: Over 2,000,000
Spotify in 60 Seconds (mean average)
• Goal: To make all the world’s music available instantly
to everyone, wherever and whenever they want it.
Number of employees: 400 +
• The name: A combination of spot and identify.
• Over 100 engineers
Features
Features
Metadata Search
Features
Highlights Radio Devices Offline
Mode
Features
Social: Spotify
Features
Social:Facebook
Features
Music
Spotify & AWS Retrospective
First experimented with AWS in 2009
Elastic MapReduce
(Content Analysis)
CloudFront
(Client Delivery & Popular Tracks)
S3
(Master Storage)
The Need for Speed
Why is 265 ms mean average
playback experience important?
Local feel
Impatient users
Shoot for the moon principle
Makes for a fun technical
project
Harder, Faster, Better,
Stronger
Spotify’s Music Architecture (Before AWS)
SPOTIFY SITE
Master Storage
Tracker
Prod Storage
Ads*
Radio*
Browse
SearchDESKTOP P2P
AP
MOBILE/LIBSPOTIFY
HTTP ENCRYPTED *NYC PROJECT
Content
Spotify’s Music Architecture
SPOTIFY SITE
Tracker
Prod Storage
Ads*
Radio*
Browse
SearchDESKTOP P2P
AP
MOBILE/LIBSPOTIFY
HTTP ENCRYPTED *NYC PROJECT
S3Master Storage
Content
Streaming Sweet Tunes: SOP
Click Play…
Look in the client’s cache
Look in the P2P Neighboorhood
Look in production storage
Look in S3
Found It!
Streaming Sweet Tunes: Really Popular Songs
Click Play…
Look in the client’s cache
Look in the P2P Neighboorhood
Get CloudFront URL
Found It!
Delivering Clients via CloudFront
EMIL! CAN WEUPGRADE ALL
SPOTIFY CLIENTSIN 24 HOURS?
But Oskar! We don’thave the servers!
There is no Time!
I called our AWS Rep!CloudFront delivered
All ClientUpgrades!
HARDER,BETTER, FASTER,
STRONGER!
SWEET!
R&D with AWS
One-off batch process jobs that require a massive
computing power…
S3 and Elastic MapReduce for data aggregation.
S3 and EC2 content analysis, finger printing and
content matching research.
AWS APIs to manage instances for big fast projects
Looking at reduced redundancy for low bit rates
Summary
AWS is a part of Spotify’s Music Architecture…
Not used for user-facing services but rather to feed our
backend.
AWS is a part of Spotify’s development process…
We test ideas, run big jobs, and have a lot of fun with it!
For Spotify AWS is a reliable and high value solution…
Headache Medicine
There’s a new world of music
awaiting you…