optimizing cassandra in aws

37

Upload: greggulrich

Post on 14-Jul-2015

493 views

Category:

Technology


1 download

TRANSCRIPT

Netflix

AWS Cassandra

0

5

10

15

20

25

Req

uests

in

Billi

on

s (

per

day)

Netflix API – Growth in requests

Data Center Capacity

1c1d

1e

1c

1d

1e1c

1d

1e

1c

1d

1e1a

1b

1c

1a

1b

1c1a

1b

1c

1a

1b

1c

S3 S3

us-east-1 eu-west-1

S3

us-west-2

Durability (Quorum)

One instance:

Availability zone:

Replica set:

23

24

25

26

174373

366828

537172

1099837

0

200000

400000

600000

800000

1000000

1200000

0 50 100 150 200 250 300 350

Client Writes/s by node count – Replication Factor = 3

50 Number of production clusters

15 Number of multi-region clusters

4 Max regions, one cluster

101 Total TB of data across all clusters

780 Number of Cassandra nodes

72/32 Largest Cassandra cluster (nodes/data in TB)

250k/800k Max read/writes per second on a single cluster

http://techblog.netflix.com

http://netflix.github.com

We are sincerely eager to

hear your FEEDBACK on this

presentation and on re:Invent.

Please fill out an evaluation

form when you have a

chance.