nosql tel aviv meetup #2: nosql at scale - architecture and common pitfalls

13
NoSQL at Scale: Architecture and Common Pitfalls Arthur Gimpel [email protected]

Upload: nosql-tlv

Post on 19-Feb-2017

248 views

Category:

Internet


1 download

TRANSCRIPT

Page 1: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

NoSQL at Scale: Architecture and Common Pitfalls

Arthur Gimpel [email protected]

Page 2: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›2

About Me

•Working with databases for 8 years

•5 years, SQL Server & .NET

•3 years with NoSQL & Python & Node.js

•2015 - Founded DataZone

Page 3: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›3

DataZone | Data is our business! What’s yours?

•Consultancy & projects

•Private & public training

•Multi vendor, multi tier support with SLA

•Child unit of CloudZone, public cloud leaders

Page 4: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

NoSQL Why Not?

Page 5: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›5

All the wrong reasons…

•Web Scale! Web Scale!

•Costs reduction*

•Free school for developers

Source: mongodb-is-web-scale.com

Page 6: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Common Pitfalls

Page 7: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›7

RDBMS Practices

Normalization in the low cost storage era

Page 8: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›8

RDBMS Practices

Expecting the Wrong Features

Jobs

Mailing Servers

Queues

TriggersStored

Procedures

Shell

Commands

Page 9: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›9

RDBMS Practices

ORM != ODM

Object Relational Mapping - Targets:

•Speeding development.

•Mapping multiple relations to Objects

•Simple Standard CRUD

Object Document Mapper - Targets:

•Managing references & embeddeds

•Typing your data

•Retries, Events, Transactions

Page 10: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›10

Architecture

Commodity hardware - over distribution

Cluster 1Cluster 2

Page 11: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›11

Architecture

Cluster Majority

A

Cluster 1

B

C

A

Cluster 2

B

Page 12: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Arthur Gimpell

‹ ›12

Summary

Adjust the technology to your needs, not vice versa.

Be aware of your engine’s distribution model, plan your cluster accordingly.

Model your data by the engine’s best practices - read them.

Don’t over size, don’t under size, run performance tests on various deployments.

Databases are made for storing & efficiently manipulating data, not sending emails.

Run Backups! Replication is not a replacement for cold backups.

Page 13: NoSQL Tel Aviv Meetup #2: NoSQL At Scale - Architecture and Common Pitfalls

Thank you

Arthur Gimpel [email protected]