aws techworkshop dynamodb / customer presentation: infopark ag

22
Berlin, 2012-03-07 AWS TechWorkshop DynamoDB Customer Presentation: Infopark AG

Upload: thomas-witt

Post on 05-Dec-2014

1.928 views

Category:

Technology


1 download

DESCRIPTION

Why we've chosen the new DynamoDB as our cloud database

TRANSCRIPT

Page 1: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Berlin, 2012-03-07

AWS TechWorkshop DynamoDB

Customer Presentation:Infopark AG

Page 3: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Great Websites run InfoparkWeb-Sites for large-scale companies

Founded 1994 in Berlin

CMS and CRM in the cloud

Page 4: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

HistoryHow we made it to the cloud …

Page 5: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

AZ 1

System Architecture

EC2 App Server

AZ 2

EC2 App Server

AZ 3

EC2 App Server

Elastic Load Balancer

MySQL DB Master

MySQL Master- Master

Page 6: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

SQL databases are not built for the cloud.

Bottleneck

Doesn‘t scale

Single point of failure

Adding new Replicas

Consistent backups

Recovery times after crashes

Page 7: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Database(Choose wisely)

Page 8: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Kudos to http://blog.nahurst.com/visual-guide-to-nosql-systems

Comparision

A

C P

Availability: Each client can always read and write

Consistency: All clients always get

the same data

Partition Tolerance: System works despite

network splits

Pick Two

RelationalKey-valueColumn-oriented/TabularDocument-oriented

DynamoDBCassandraSimpleDBCouchDBRiak

RDBMS(MySQL, Oracle, …)

MongoDB,Redis,Bigtable

Page 9: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

NoSQL - So many choices …

MongoDB

Riak

CouchDB

BigCouch

Redis

Cassandra

… remember that you have to run all of these on EBS :-(

Page 10: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

MongoDB

Advantages

Auto-Sharding

Good performance

Dynamic query interface

Disadvantages

Global Write-Lock

No automatic rebalancing, Master-Slave-Replicationw/ Auto Failover

Page 11: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Redis

Advantages

Performance (in-memory)

Transactions

Disadvantages

Only Master-Slave-Replication

Limited by memory

Page 12: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Cassandra

Advantages

Automatic Replication and Rebalancing (N,R,W)

Secondary Indices

Disadvantages

Writes are faster than reads

Bad scaling for 2nd indexes

Super-complex to handle

Page 13: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Riak

Advantages

Automatic Replication and Rebalancing (N,R,W)

Secondary Indices

Large Blobs

Map/Reduce

Disadvantages

InnoDB Backend, slow writes

Page 14: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

CouchDB

Advantages

Bidirectional replication

Crash Only-Design

Changes Feed

Views via JS Map Reduce

Disadvantages

Serialized Writes

Sharding/Rebalancing only with BigCouch

Page 15: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Our History

We started with Bigcouch

Switched to CouchDB

Considered Riak

… and now went to DynamoDB

Page 16: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Management-Intense

They are all very …

Page 17: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

http://highscalability.com/blog/2012/1/24/the-state-of-nosql-in-2012.html

Any system that you pick will require 24-7 operational support. If it is not hosted (e.g. by AWS), be prepared to hire a fleet of ops folks to support it yourself. If you don’t have the manpower, I recommend AWS' DynamoDB.

– Siddharth Anand, LinkedIn

Page 18: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

AZ 1

System Architecture today

EC2 App Server

AZ 2

EC2 App Server

AZ 3

EC2 App Server

Elastic Load Balancer

S3Assets

Scalarium

ElasticSearch

DynamoDB

ElasticSearch ElasticSearch

Page 19: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Advantages of DynamoDB

Advantages

Zero Administration

Blazing fast, thanks to SSD

Scalability with one parameter

Fair Pricing

Conclusion

We're switching to DynamoDB as soon as it's available in the EU region

Page 20: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

What's missing so far?

Secondary indices

Changes Feed

Out-of-the-box-Backup

Batch PUT/DELETE

Page 21: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG
Page 22: AWS TechWorkshop DynamoDB / Customer Presentation: Infopark AG

Infopark AG • Kitzingstraße 15 • D-12277 Berlin • www.infopark.de • [email protected]

[email protected]+49-151-140690-23

Twitter: @thomas_witt

Thomas Witt

That's a wrap!

Thank you!

Director Product & Business Development