Frank OberSolutions Architecture Team – Non-Volatile Memory Solutions Group@fxober

http://www.spec.org

http://www.intel.com/info/hyperthreading

http://www.intel.com/go/turbo

Type Speed Usage Players

Key value databases Fastest Operational MemcacheDB, Redis, Aerospike

DynamoDB(Amazon). LevelDB (Google), Rocksdb (Facebook)

Big Table , Column-based.

Faster Analytics BigTable, Cassandra, Hbase (*Hadoop)

Document Databases Faster Web Sites MongoDB (WiredTiger v3.0 is released)Couchbase (ForestDB releases June 2015)

Graph databases Fast Social Graphs Neo4J

Level DB and how SSTable works - https://www.igvita.com/2012/02/06/sstable-and-log-structured-storage-leveldb/

Flash and Storage Filesystems - http://radar.oreilly.com/2014/08/how-flash-changes-the-design-of-database-storage-engines.html (sponsored by Aerospike)

NVM KV – Store (Read Side is Direct):

NVM KV Store is asynchronously written through a memory buffer.

Aerospike Conf file setting: write_block_size128k is default

Post-write-queue 256 is default

3 Clients You need to spread the loadHere Dell 620 dual sockets are used

DUAL 10Gbit networks Dell R730xd Server System

One primary (dual system with replication testing)Dual CPU socket, rack mountable server systemDell A03 Board, Product Name: 0599V5CPU Model used2 each - Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz max frequency: 4Ghz18 cores, 36 logical processors per CPU36 cores, 72 logical processors totalDDR4 DRAM Memory128GB installedBIOS VersionDell* 1.0.4 , 8/28/2014Network AdaptersIntel® Ethernet Converged 10G X520 – DA2 (dual port PCIe add-in card)1 – embedded 1G network adapter for management2 – 10GB port for workloadStorage AdaptersNoneInternal Drives and Volumes/ (root) OS system – Intel SSD for Data Center Family S3500 – 480GB Capacity/dev/nvme0n1 Intel SSD for Data Center Family P3700 – 1.6TB Capacity, x4 PCIe AIC/dev/nvme1n1 Intel SSD for Data Center Family P3700 - 1.6TB Capacity, x4 PCIe AIC/dev/nvme2n1 Intel SSD for Data Center Family P3700 - 1.6TB Capacity, x4 PCIe AIC/dev/nvme3n1 Intel SSD for Data Center Family P3700 - 1.6TB Capacity, x4 PCIe AIC6.4TB of raw capacity for Aerospike database namespaces

Aerospike Community Version 3.5.8

https://communities.intel.com/community/itpeernetwork/blog/2015/02/17/reaching-one-million-database-transactions-per-second-aerospike-intel-ssd

Record SizeAerospike

Number of clients threads

Total TPS

Percent below 1ms (Reads)

Percent below1ms(Writes)

Std Dev of Read Latency(ms)

Std Dev of Write Latency (ms)

Approx. Database size

1k 576 1,124,875 97.16 99.9 0.79 0.35 100G

2k 448 875,446 97.33 99.57 0.63 0.18 200G

4k 384 581,272 97.22 99.85 0.63 0.05 400G

1k (replication)

512 1,003,471 96.11 98.98 0.87 0.30 200G

Record Sizeiostat

Read MB/sec Write MB/sec Avg queue size on SSD

Average drive latency

CPU Busy %

1k 418 29 31 0.11 93

2k 547 43 27 0.13 81

4k 653 52 20 0.16 52

1k (replication)

396 51 30 0.13 94

Storage Types Cost per GB 1k transaction/socket Memory Capacity

DRAM only $10-15 + (DDR4) ~1.6 million tps (1socket)

192GB – 768 GB

SSD Configuration $1-3 + (PCIe SSD –retail channel)

~600k per node (1 socket)

4 x 2TB = 8TB10# SFF NVMe servers

3x lower transactions per second, yet 5x lower price per GB with NVM.

Capacity is higher, cost is much lower allowing you to do more per unit of rack.

Areas of improvement exist:

1. Iowait percentage is pretty high here: 13%, and because all SSD’s degrade with writes, you really want to achieve the most that you can with good SSD’s. Endurance is not the issue here, what is the issue is the NAND characteristics related to writes and overall (R+W) latency with write characteristics.

2. Software IRQ (14%)– this is an opportunity to help balance the network and storage drivers more effectively over time.

1. There are several innovation projects going on between Intel – Aerospike related to optimizations…

asadm (asmonitor)

top, htop (mpstat)

iostat

iotop –o

iftop, tcpdump/Wireshark

http://www.tecmint.com/command-line-tools-to-monitor-linux-performance/

Intel CPU monitor (PCM)

vtune

mlc-

@IntelSSD https://twitter.com/intelssd

http://communities.intel.com

https://communities.intel.com/community/itpeernetworkhttps://communities.intel.com/people/FrankOber/content

https://communities.intel.com/community/tech/solidstate

http://www.intel.com/support

https://www.linkedin.com/company/it-center

@aerospikedb

http://www.aerospike.com/get-started

http://aerospike.com/docs

http://www.aerospike.com/act/

https://www.aerospike.com/docs/operations/plan/ssd/ssd_certification.html