scaling opentsdb · pdf filescaling opentsdb benoît “tsuna” sigoure...

Scaling OpenTSDB

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

Or how to deploy OpenTSDB as your monitoring system to store trillions of data points and add

billions per day effortlessly

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

TSD

HBase

Writes Reads

Basic Setup

} 1-10 nodesand up

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

TSD host 1

HBase

Writes Reads

TSD host 2 TSD host 3

Scale out

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

write read

HBase

Writes Reads

write read write readTSDs

Separate reads and writes

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

write read

HBase

Writes Reads

write read write readTSDsLB LB LB

Varnish

Load balance reads

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

write read

HBase

write read write readTSDsLB LB LB

Varnish

Load balance reads

URL?

Benoît “tsuna” Sigouretsunanet@gmail.com

tsuna@aristanetworks.comhttp://opentsdb.net

write read

HBase

write read write readTSDsLB LB LB

Varnish

Add some tmpfs for cache

tmpfs tmpfs tmpfs