cassandra on azure - "tel-aviv-cassandra-users" meetup 2015

CASSANDRA ON AZURE? REALLY?!Oded Peer, RSA Security

2© Copyright 2015 EMC Corporation. All rights reserved.

THE ELEPHANT IN THE ROOM


• Only two leaders in Gartner Magic Quadrant for Cloud IaaS (2015)

• Only two leaders in Gartner Magic Quadrant for Public Cloud Storage Services (2014)

• Computing capacity: AWS has X10 the combined competition, Microsoft has X2 the non-Amazon combined competition

• Cloud platform revenues: AWS 6bn revenue, Azure 1.5bn

AZURE AND AWS


AZURE IAAS


Type CPU RAM (GB) Temp Storage (GB)

IOPS $/mo

A7 8 56 605 16*500 655A8 8 56 382 16*500 1091

VM TYPES



IOPS $/mo

A7 8 56 605 16*500 655A8 8 56 382 16*500 1091D13 8 56 400 (SSD) 16*500 521D14 16 112 800 (SSD) 32*500 1032D13_v2 8 56 400 (SSD) 16*500 599

VM TYPES



IOPS $/mo

A7 8 56 605 16*500 655A8 8 56 382 16*500 1091D13 8 56 400 (SSD) 16*500 521D14 16 112 800 (SSD) 32*500 1032D13_v2 8 56 400 (SSD) 16*500 599DS13 8 56 112 (SSD) 25,600

256 MB/SD13++

VM TYPES



IOPS $/mo

A7 8 56 605 16*500 655A8 8 56 382 16*500 1091D13 8 56 400 (SSD) 16*500 521D14 16 112 800 (SSD) 32*500 1032D13_v2 8 56 400 (SSD) 16*500 599DS13 8 56 112 (SSD) 25,600

256 MB/SD13++

G4 16 224 3072 (SSD) 32*500 3274GS4 16 224 448 (SSD) 40,000

1000 MB/SG4++

VM TYPES


• Ephemeral – Fast, data loss

• Standard – 16k IOPS limit (single VM)

• Premium (SSD) – Per-disk IOPS limit

STORAGE OPTIONS


Type Size (GB) IOPS ThroughputMB/S

$/mo

P10 128 500 100 18P20 512 2300 150 66P30 1024 5000 200 122

PREMIUM STORAGE PRICING


• Data and logs on ephemeral SSD– 100k IOPS and 1.5 GB/sec on G5

• Data and logs on premium storage– Striped volumes (better than JBOD)– Network latency 1-3 ms– Max 64 TB, 80k IOPS and 1 GB/sec disk throughput– Use standard storage for backup snapshots

• Data on premium logs on ephemeral

CASSANDRA STORAGE OPTIONS


• Logically isolated network• Within a VNET bandwidth is a function of VM type

– Up to 20 Gbps for G5• VNET to VNET VPN gateway

– Cross region support– Standard (100 Mbps)– High performance (200 Mbps)– Latency according to distance

VNET AND MULTI-REGION DEPLOYMENT


• Availability Zones

PLACING REPLICAS


• Availability Zones• Upgrade Domain, Fault Domain

PLACING REPLICAS


• Availability Zones• Upgrade Domain, Fault Domain – assigned at deployment

PLACING REPLICAS


AUTOMATIC DEPLOYMENT


• Single node sandbox• DSE cluster (BYOL)• Single region• 4, 12, 36 or 90 nodes• Choose your VM type (D12-D14, G2-G5)• Ephemeral storage• Includes OpsCenter

AZURE MARKETPLACESIMPLIFIED DEPLOYMENT


• Fully managed Cassandra-as-a-Service hosted on Microsoft Azure

• Apache Cassandra and DSE• Multiple Cassandra versions• OpsCenter• Uses D-series VMs• Multi region

MANAGED CASSANDRA


REAL WORLD USE CASES


• DSE on Ubuntu• Single Azure region, 2 vDC• G4 nodes, considering D14_v2• Data on ephemeral disks• 12 nodes: ingest 20k - 50k events/sec• 30 nodes: ingest 200k events/sec

OFFICE 365


• DS13 VMs (8 CPUs, 56 GB RAM)• 16 p10 premium storage disks• Single Azure region• Combination of Upgrade Domain and Fault Domain for replica

placement

ADAPTIVE AUTHENTICATION


• Your mileage may vary• Microsoft eager to help• VPN throughput lower than expected• Commitlog flush IO spikes change in flush interval• LCS STCS to reduce compaction IO

TIPS


THANK YOU

cassandra on azure - "tel-aviv-cassandra-users" meetup 2015

Software