imc summit 2016 innovation - dennis duckworth - lambda-b-gone: the in-memory case study for faster,...

LAMBDA-B-GONE: IN-MEMORY CASE STUDY FOR FASTER, SMARTER AND SIMPLER ANSWERS

DENNIS DUCKWORTHVOLTDB See all the presentations from the In-Memory

Computing Summit at http://imcsummit.org

VOLTDB An operational database purpose-built to run 100% in-

memory at web scale In-Memory Relational, SQL, fully ACID compliantScale-out on commodity hardwareReliability, HA, fault tolerant Integration with OLAP, Hadoop, DW Best use cases: operational and transactional workloads

ORIGINAL LAMBDA ARCHITECTURE

VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE

CASE STUDY

5

Content Delivery Network Service Provider

Business challenges:- Real-time analytics for customers- Data accuracy: over/under billing- Scalability

SQL interface unlike Trident or Spark-Streaming Merges the good things of the old-world like SQL and transactions

with the good things of the new world like ‘no-locks’, ‘k-factor’ HA, etc….

Very simple and intuitive API and usage k-factor + logs + snapshots eliminates the need to backup the

system Fast query performance Horizontal scalability

MAXCDN FINDINGS: VOLTDB ADVANTAGES

MAXCDN FINDINGS: VOLTDB ADVANTAGES

MAXCDN RESULTS

8

Simplified system architecture

1/10th the compute resources

100% budget accuracy, eliminated $$$ under/over spending

Faster time to value“We chose to go with VoltDB over other streaming aggregate solutions (like Trident) for its SQL interface, real-time Ad-Hoc queries over our raw data, and simpler overall design”Behzad Pirvali, Architect, MaxCDN

REAL-TIME IN-MEMORY OLTP AND ANALYTICS WITH APACHE IGNITE ON AWS BY BABU ELUMALAI

HTTP://BLOGS.AWS.AMAZON.COM/BIGDATA/POST/TX3RS3V80XNRJH3/REAL-TIME-IN-MEMORY-OLTP-AND-ANALYTICS-WITH-APACHE-IGNITE-ON-AWS

AMAZON DYNAMODB

AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT

AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT + SPARK + SPARK STREAMING +

AMAZON DYNAMODB + AWS LAMBDA + KINESIS FIREHOSE + S3 + REDSHIFT + SPARK + SPARK STREAMING IGNITE + KCL

VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE

VOLTDB-IMPROVED VERSION OF LAMBDA ARCHITECTURE

ONE LAST THOUGHT: WORD OF THE DAY

IDEMPOTENCETHE PROPERTY OF CERTAIN OPERATIONS IN MATHEMATICS AND

COMPUTER SCIENCE, THAT CAN BE APPLIED MULTIPLE TIMES WITHOUT CHANGING THE RESULT BEYOND THE INITIAL

APPLICATION.

DONE - THANK YOU

If you want to talk about how real transactions (and idempotence) can help you, come see us.

http://voltdb.com

@dennisduckworthdduckworth@voltdb.com

all images from wikimedia w/ cc license unless otherwise noted