CSS LABS

Distributed Key-Value StoresFeaturing Riak

Story of a 5 Node ClusterStory of a 5 Node Cluster

Hi, i am qiak

Hi, i am piak

Hi, i am riak Hi, i am siak

Hi, i am tiak

Once upon time there were five nodes...

CSS LABS

... and they formed a Ring

Qiak, I willTake care.

Too drunk!

All is well! I am hit!

Siak! I amthere!

They together kept a lot of data...

Story of a 5 Node ClusterStory of a 5 Node Cluster

CSS LABS

... some shared, some not ...... they were always willing to cover up

Well, hello!

Hi Viak!

Great tohave you!

Ah! did youknow?

Guys! This isviak.

They were welcoming...

Hi, i am viak!

Story of a 5 Node ClusterStory of a 5 Node Cluster

CSS LABS

... they were together called Riak!

Riak ClusterRiak ClusterThe Features

* Decentralized

* Key-Value Store

* Document Oriented * Map-Reduce

* RESTful API: jiak

* Erlang Advantage

CSS LABS

Riak ClusterRiak ClusterThe Features

* Decentralized * No master

* Node Independence

* Failure Tranperancy

CSS LABS

Riak ClusterRiak ClusterThe Features

* Key-Value Store* NoSQL

* Memory Footprint

* Logical data

CSS LABS

Riak ClusterRiak ClusterThe Features

* Document Oriented

* No Tables

* Field Flexibilty

* Extensible

CSS LABS

Riak ClusterRiak ClusterThe Features

* Erlang Advantage* Designed to Distribute

* Concurrent Processes

* No Shared State

CSS LABS

Riak ClusterRiak ClusterThe Features

* RESTful API: jiak* In Thing

* Small Learning Curve

* Web 2.0

CSS LABS

Riak ClusterRiak ClusterThe Features

* Map-Reduce

* Already Key-Value

* Huge Data

* Clustered

CSS LABS

Riak ClusterRiak ClusterThe Concepts

A.C.I.D.* C.A.P.+

* Atomicity Consistency Isolation Durability

+ Consistency Availability Partition Tolerance

CSS LABS

Riak ClusterRiak ClusterThe Concepts

CSS LABS

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E B's Key range: Range

EB

A's Key range: Range

BA

Keys map onto points, on the ring, determined by

some hash function

CSS LABS

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E B's Key range. Range

EB

A's Key range. Range

BA

B Crashes, now the range?Range

EA

CSS LABSKeys map onto points, on the ring, determined by

some hash function

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E B's Key range: Range

EB

A's Key range: Range

BA

The Key is hashed onto the ring, in Range

BA

Hence data stored in A

Replicas of the data are

maintained.

CSS LABSKeys map onto points, on the ring, determined by

some hash function

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E B's Key range: Range

EB

A's Key range: Range

BA

F

New Node F, Splits the range.

RangeDF

& RangeFC

The Key is hashed onto the ring, in Range

BA

Hence data stored in AReplica of

RangeBA

is

moved here

Drops the replica of Range

BA

CSS LABSKeys map onto points, on the ring, determined by

some hash function

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E

F

N = 3CSS LABS

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E

F

W = 2CSS LABS

Riak ClusterRiak ClusterThe Concepts

D

A

B

C

E

F

R = 2CSS LABS

Riak ClusterRiak ClusterThe Concepts

DocV0

CSS LABS

Riak ClusterRiak ClusterThe Concepts

DocV0

DocV0

CSS LABS

Riak ClusterRiak ClusterThe Concepts

DocV1

DocV0

DocV1

CSS LABS

Riak ClusterRiak ClusterThe Concepts

DocV0

DocV1

DocV1

CSS LABS

Riak ClusterRiak ClusterThe Concepts

DocV0

DocV0

DocV1a

DocV1b

CSS LABS

Riak ClusterRiak ClusterThe Concepts

DocV1b

DocV1a

CSS LABS

Riak ClusterRiak ClusterOperating on it.

CSS LABS

?Riak ClusterRiak Cluster

The Competition.

CSS LABS

Riak ClusterRiak ClusterThe Competition.

CSS LABS

Cassandra

Voldemort

CouchDB

Scalaris

?

CSS LABS

Riak ClusterRiak ClusterUse cases

CSS LABS

Riak ClusterRiak ClusterUse cases

Log Aggregation

Photo Store

Session Store

Tag Clouds

CSS LABS

Thank You!