Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |

Presented by

Oracle NoSQL Database

Andrey Rivkin Technical Consultant FORS Distribution October 16, 2014


Agenda

A bit of history and what is NoSQL

Data Model

Architecture

Consistency

When to use

Community Edition vs Enterprise Edition

What’s new in release 3.0


Reasons for creating NoSQL technology

The appearance in the early 2000s:

• Google - web search engine

• Facebook – social network

• Amazon - online retailer

Common features of these systems:

• Constantly changing structure

• Unpredictable data growth

• A huge number of users


What is NoSQL?

NoSQL = Not only SQL.

Do not have a structured scheme - Frequently the data is stored in the scheme of key-value - The structure of the database schema is created by the application

Allow almost infinite horizontal scale - The data is stored in the copies on different servers - Node failure does not result in data loss - Reading is done from the master or a copies

Working with data through a simple operations (no SQL)

- CREATE - RETRIEVE

- UPDATE - DELETE


Oracle NoSQL Database Horizontally Scaled, Key-Value Database for Web Services and Cloud

• Simple Data model Based on Key-value scheme with two parts key – major +

minor

Simple operations read/insert/update/delete

• Scalability Optimized data access

Smart division and distribution of data

• High Availability & No-Single Point of Failure single-master, multi-replica database replication

automated fail-over election

• Transparent Load Balancing Read from master or/and replicas

Network topology and latency-aware

Storage Nodes Data Center A

Storage Nodes Data Center B

Application

NoSQL DB Driver

Application

NoSQL DB Driver


Key – Value pair

Oracle NoSQL Database hashes keys to provide good distribution over a collection of computers that provide storage for the database.

A key is the concatenation of a Major Key Path and a Minor Key Path, both of which are specified by the application.

A minor component does not affect the distribution and can be empty.

Key


Key – Value pair

Oracle NoSQL Database stores value as byte array.

Mapping of the byte arrays to data structures is done by application.

There are no restrictions on the size or structure of the value field.

Value


Logical representation of Oracle NoSQL Database

Key Value

Key 1 Value 1

Key 2 Value 2

Key 3 Value 3

Key 4 Value 4

Key 5 Value 5

Key 6 Value 6

Index

Key 1 – Value 1

Key 5 – Value 5

Key 4 – Value 4

Key 2 – Value 2

Key 3 – Value 3

Key 6 – Value 6


Physical representation of Oracle NoSQL Database

Key 1 – Value 1

Key 5 – Value 5

Key 4 – Value 4

Key 2 – Value 2

Key 3 – Value 3

Key 6 – Value 6

server rack 1 server rack 2

Key 1 – Value 1 Key 1 – Value 1







Physical representation of Oracle NoSQL Database server rack 1 server rack 2








server rack 1 server rack 2







Storage architecture

Shard 1 (Replication Group 1)



Master

Master

Master

Slave

Slave

Slave


Storage architecture

Key 1 – Value 1

Key 4 – Value 4

Oracle NoSQL Database

Storage Node







Master

Master

Master

Slave

Slave

Slave


How Does it work?

Client

Replication Group

Master

Replica Replica Key – Value pairs


Client

How Do We Read?

get( )

hash( )

LUT( )


Consistency of data

BASE

Basically Available Soft state Eventual consistency

ACID

Atomicity Atomicity requires that each transaction is "all or nothing": if one part of the transaction fails, the entire transaction fails, and the database state is left unchanged.

Consistency The consistency property ensures that any transaction will bring the database from one valid state to another.

Isolation The isolation property ensures that the concurrent execution of transactions results in a system state that would be obtained if transactions were executed serially, i.e. one after the other.

Durability Durability means that once a transaction has been committed, it will remain so, even in the event of power loss, crashes, or errors.


Consistency of data

Oracle NoSQL Database – ACID or BASE system? Can be configured for the whole system and for a particular operation!


In which case you should use Oracle NoSQL Database?

Terabytes or petabytes of data

The application should not have a single point of failure

The use of multiple low-cost servers

Short response time of simple queries

Unstructured or semi-structured data model


Potential systems for Oracle NoSQL Database LDAP like systems Why? It’s fast! User personalization Why? No clear data model and constant addition of new features! Collection of different types of data from the sensors Why? A lot of concurrent sessions! Logging of Internet traffic (CDR GPRS, web logs) Why? Huge amount of data! File storage (like Dropbox, Google disk) Why? Cheap store of large amounts of unstructured data!


Oracle NoSQL Database Community VS Enterprise Edition

Oracle NoSQL Database Community Edition. Open Source. GPLv2 or AGPL license.

Oracle NoSQL Database Enterprise Edition. Closed Source. Standard Oracle License. List price: $10K/CPU.


Oracle NoSQL Database benefits Community Edition

1. Java and C APIs

2. Store billions of records and multi-terabytes of data

3. No-Single Point of failure

4. Designed to scale out to thousands of nodes

5. Streaming Large Object Support

6. Easy online administration

7. Online rolling upgrade

8. Efficient Multi-Zone support

9. Integrated with Apache Hadoop


Oracle NoSQL Database Enterprise Edition includes all features available in Community Edition, plus these additional features: Simple Network Management Protocol (SNMP) adapter for monitoring Oracle Database Integration via External Tables: Access data through SQL queries Integration with Oracle Event Processing (OEP) engine using NoSQL database cartridge:

Access data through CQL queries Integration with Oracle Coherence to permit Oracle NoSQL Database to be used as a

cache for Oracle Coherence applications and to allow applications to directly access cached data from Oracle NoSQL Database.

A Java-based interface to store and query semantic data through support for the Resource Description Framework (RDF), SPARQL query language, and a subset of the Web Ontology Language (OWL) are now supported.

Enterprise Grade Support (24x7) for Enterprise Edition (EE).

Oracle NoSQL Database benefits Enterprise Edition


Table data model support – Simplifies data modeling & leverages existing “table” expertise

Secondary indexing – Allow indexing on any component of the record

– Huge performance benefit due to parallel, indexed data access

Data centers – Metro-area zones for disaster recovery and business continuity

– Secondary zones for read-only workloads

Security – Authentication and network-level encryption

Oracle NoSQL DB Release 3.0


Lower barrier to adoption, shorter time to market

Simplified application modeling – Uses familiar table concepts

– Introduces strongly typed fields

– Easy to/from JSON with full type support and AVRO serialization

– Allows secondary indexing of non-key data

Sets foundation for SQL query access from Oracle DB

Previous Key/Value and JSON schema APIs still supported

Oracle NoSQL DB Release 3.0 Table model benefits


Oracle NoSQL DB Release 3.0 Secondary Index support

Broader low latency use case support – Primary and Secondary Indexes

– Indexes automatically maintained

– Provides sorted results

Low resource cost with high performance – Low cardinality matching, guaranteed consistent

– Shard-local indexing, low latency record access

– B-trees locally ordered, scanned in parallel, merged result set

– Improved index cache eviction


Oracle NoSQL DB Release 3.0 Secondary Index

Get() API specifies index Equality or range searches Low order multi-value indexes

– Composite index on values

– Parallel Index ScanA

– Ordered results

– Indexable single element arrays

Equality search on lname + fname

Equality search on lname and range on fname

Range or Equality search on lname by itself

Can’t search on just fname

Index on (lname, fname)

UserId fname lname email Table

Users


Oracle NoSQL DB Release 3.0 Zones

Metro-Local Quorum – Low latency writes, HA

2nd’ary Read-Only Zones – Analytic workloads

– Report generation

– Asynchronous replication

New Read Consistency: No Master

Topology Aware Client Driver

Provides business continuity and distributed workload management

DC1 DC2 DC3

Metropolitan Zones

Reports

Batch Analytics


Oracle NoSQL DB Release 3.0 Security Overview

Protected Access to Data – Enforcement is configurable

Authentication – OS independent, password based user access

– Internal cluster components self authenticate (HA password distribution)

– Oracle Wallet integrated

– Admin utility to generate self-signed certificates

Wire level data encryption – All client-server, server-server channels SSL encrypted


• Free test of Oracle NoSQL database is available here:

http://www.oracle.com/technetwork/database/database-technologies/nosqldb/overview/index.html

• Try Oracle Big Data Lite Virtual Machine:

http://www.oracle.com/technetwork/database/bigdata-appliance/oracle-bigdatalite-2104726.html

32

Try it yourself!

http://www.oracle.com/technetwork/database/database-technologies/nosqldb/overview/index.html?ssSourceSiteId=ocomen


















Q&A

33

Andrey Rivkin FORS Distribution Big Data Specialist [email protected] ISV Migration Center blog: http://blogs.oracle.com/imc ISV Migration Center email: [email protected]



mailto:[email protected]


• Oracle.com Partner Hub oracle.com/partners/goto/hub-ecemea

• Migration Center Team Blog blogs.oracle.com/imc

feeds.feedburner.com/oracleIMC

• Partner Webcast Recordings youtube.com/OracleIMCteam

• Partner Webcast Presentations slideshare.net:/Oracle_IMC_team

• [email protected]

Oracle Partner Hub ISV Migration Center • twitter.com/OracleIMC

• plus.google.com/+OracleIMC

• facebook.com/OracleIMC

• linkedin.com/groups/Oracle-Partner-Hub-Migration-Center-4535240

http://oracle.com/partners/goto/hub-ecemea






http://www.slideshare.net/oracle_imc_team








https://plus.google.com/108612216492389783792




http://linkedin.com/groups/Oracle-Partner-Hub-Migration-Center-4535240














https://www.facebook.com/oracleimc


https://www.youtube.com/OracleIMCTeam

partner webcast – oracle nosql key-value database

Documents