bringing your applications to the fast lane (cpn203) | aws re:invent 2013

© 2013 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified, or distributed in whole or in part without the express consent of Amazon.com, Inc.

Deepak Singh - Amazon Web ServicesChristos Kalantzis - NetflixSteven Jones - Amazon Web Services

November 15, 2013

Bringing Your Applications to the Fast Lane

Friday, November 15, 13

Hello!


3Friday, November 15, 13

Instance Types


Performance


Generations


Many instance types


Building Blocks


General PurposeCompute-optimizedMemory-optimizedStorage-optimizedGPUMicro

M1, M3C1, CC2M2, CR1HI1, HS1CG1, G2Micro


Workload optimized


Compute-optimized


CC2


2.6 GHz Intel Xeon E5-2670


16 cores/32 vCPU


10 Gbps cluster networking


High Performance Linpack


Cores 17024

Rmax 240.09

Rpeak 354.12

cc2.8xlarge


I/O


HI1 instances


High random I/O performance


SSDs


Netflix and HI1

Christos Kalantzis


Advantages of using hi1.4xlarge with C*

• Higher application speed• Efficient operations & better data quality• Cost savings


Higher Application Speeds

• Compared m2.4xlarge & hi1.xlarge• 6 node C* cluster with 250 GB data on each node• Used following Cassandra Stress tool & Options

from three m2.4xlarge clients:–cassandra-stress -d [server-list] -t 25 -r -p 7102 -n 1000000000 -k -o

READ



Cassandra-stress C*

C*

C*

C*

C*

C*Cassandra-stress

Cassandra-stress


m2.4xlarge results

Throughput Speed


hi1.4xlarge results

Throughput Speed



• 40X throughput• Better Latencies

–~37X AVG–~109X 95th %ile–~110X 99th %ile


Efficient C* Operations & Better Data Quality

• Cassandra => “benefit now, pay later”–Immutable SSTABLES need to be compacted–Can compact faster & with less impact

• Eventual Consistency–Repairs run more often–Increased Consistency without higher CL calls


Cost Savings

• Can now have multi-tenant clusters–Savings immediate on the second application–m2.4xlarge is $1.640 per hour–hi1.4xlarge is $3.100 per hour

C*App A&B

C*App A&B

C*App A&B

C*App A&B

C*App A&B

C*App A&B

C*App A

C*App A

C*App A

C*App A

C*App A

C*App A

C*App B

C*App B

C*App B

C*App B

C*App B

C*App B


Cost Savings

• Use Less Nodes–Data : Memory ratio can now be bigger–Cluster size doesn’t need to be doubled as often


Cost Savings

• Smaller Operational Footprint–Less clusters–Smaller operational teams–Less fire-fighting–Team can focus on automation


hi1.4xlarge caveats

• 10 Gbps not attained (in our model)–Need to be part of the same Cluster Placement Group–Netflix cross-zone availability model excludes CPG

• Not same as bare metal SSD running on Linux–Virtualization obfuscates some SSD advantages


Memory-optimized


244 GiB of RAM


2.6 GHz Intel Xeon E5 2670


10 Gbps cluster networking


In-memory distributed analytics


e.g. SAP HANA


Steven JonesAmazon Web Services


SAP ERP


SAP ERP BI


SAP ERP BI

Aggregates


SAP ERP BI

AggregatesPre-Defined

Queries


SAP ERP BITREXBWA

AggregatesPre-Defined

Queries


Magnetic Disk

SSD/Flash

RAM

CPU Cache

CPU Register

Latency

Storage Type


Magnetic Disk

SSD/Flash

RAM

CPU Cache

CPU Register

Latency

Storage Type

RAM is up to 100,000 x Faster


http://tinyurl.com/hana-perf

SAP HANAHigh Performance Analytic Appliance

aka In-Memory Database Platform


SAP ERP BIHANA


SAP ERPHANA


EC2 Cluster Compute instances

2 x Intel Xeon E5-2670 processors32 vCPUs with hyperthreading

64-bit60.5 GB RAM

10 Gigabit Network

2 x Intel Xeon E5-2670 processors

32 vCPUs with hyperthreading

64-bit

244 GB RAM

10 Gigabit Network

NUMA and Turbo Support

cc2.8xlarge cr1.8xlarge

New

All c* instances support high-performance (10 gigabit) networking to Elastic Block Storage volumes (EBS)


SAP HANA on AWS

1,776 Core HANA Cluster on AWS

60B Rows | 8M Rows/s | 3M Queries/h | 330ms


Where to go for HANASAP Developer Center http://bit.ly/aws-hana-devFree SAP license AWS Marketplacehttp://bit.ly/

aws-hana-one99¢ / hr SAP License

SAP HANA Marketplacehttp://bit.ly/aws-hana-byolBYOL


http://bit.ly/aws-hana-dev

http://bit.ly/aws-hana-dev

http://bit.ly/aws-hana-one




http://bit.ly/aws-hana-byol






New generations


Latest Generation Hardware


Hardware features, e.g. AVX


SSDs


Enhanced Networking


Better price-performance


C3


Best raw compute capacity


2.8 GHz Intel Xeon E5-2680v2(Ivy Bridge)


Clustering as a “feature”


High Performance Linpack


Cores 26496

Rmax 484.18

Rpeak 593.87

c3.8xlarge


0"

100"

200"

300"

400"

500"

600"

CC1" CC2" C3"

Rmax%


Cores 8192

Rmax 163.9

Rpeak 183.5

c3.8xlarge


I2


Coming Soon


Best Price for IOPS


More sizes


More SSD


More IOPS


More memory


350,000+ random read IOPS320,000+ random write IOPS

i2.8xlarge


175,000+ random read IOPS160,000+ random write IOPS

i2.4xlarge


Enhanced Networking


Enhanced Networking

Low latencyLow jitter

Very high PPS performance


cc2.8xlarge+ c3.8xlarge+ c3.8xlarge+(enhanced)+

cc2.8xlarge+ c3.8xlarge+ c3.8xlarge+(enhanced)+

Latency

PPS


p50$

p90$

p999$

p100$

Low network jitter


General PurposeCompute-optimizedMemory-optimizedStorage-optimizedGPUMicro

M1, M3C1, CC2, C3M2, CR1HI1, I2, HS1CG1, G2Micro


More to come


Please give us your feedback on this presentation

As a thank you, we will select prize winners daily for completed surveys!

CPN203 Thank You


bringing your applications to the fast lane (cpn203) | aws re:invent 2013

Technology

app bc

app abc

app ac

app afriday

xlarge hi1

efficient c

node c

hour c