doag nosql database overview · pdf fileand cli commands •manages and monitors:...
TRANSCRIPT
![Page 1: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/1.jpg)
1 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
Oracle NoSQL Database OverviewMarie-Anne Neimat, VP Development
June14, 2012
![Page 2: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/2.jpg)
Agenda
• Big Data Overview
• Oracle NoSQL Database
• Architecture
• Technical Overview
• Benchmark Results
2 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Benchmark Results
• Usage scenarios
![Page 3: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/3.jpg)
What is Big Data ?
GEODATA
TEXT
3 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
VOLUME VELOCITY VARIETY VALUE
SENSOR
DATA
![Page 4: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/4.jpg)
Big Data Lifecycle
MakeBetter Decisions
DECIDE ACQUIRE
4 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
DecisionsUsingBig Data
ANALYZE ORGANIZE
![Page 5: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/5.jpg)
Big Data Lifecycle
MakeBetter Decisions
DECIDE ACQUIRE
O
Oracle
NoSQL Database
Exalytics &
TimesTen IMDB
5 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
DecisionsUsingBig Data
ANALYZE ORGANIZE
![Page 6: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/6.jpg)
Big Data Use Cases
Today’s Challenge New Data What’s Possible
Healthcare
Expensive office visitsRemote patient monitoring
Preventive care, reduced
hospitalization
Manufacturing
In-person supportProduct sensors Automated diagnosis, support
6 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
Location-Based Services
Based on home zip codeReal time location data
Geo-advertising, traffic, local
search
Utilities
Complex Distribution Grid
Detailed consumption
statistics
Increased availability,
reduced cost, tiered metering
plans
Retail
One size fits all marketingSocial media
Sentiment analysis
segmentation
![Page 7: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/7.jpg)
Why is Big Data important?
US HEALTH CARE US RETAIL MANUFACTURING GLOBAL PERSONAL
LOCATION DATA
EUROPE PUBLIC
SECTOR ADMIN
$300 B 60+% –50% $100 B €250 B
Increase industry
value per year by
Increase net margin
by
Decrease dev.,
assembly costs by
Increase service provider
revenue by
Increase industry
value per year by
7 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
“In a big data world, a competitor that fails to sufficiently
develop its capabilities will be left behind.”
Source: * McKinsey Global Institute: Big Data – The next frontier for innovation, competition and productivity (May 2011)
![Page 8: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/8.jpg)
Oracle NoSQL Database for realtime
data management
Hadoop Distributed File
System (HDFS)Oracle NoSQL Database
File System Database
Parallel scanning Indexed storage
8 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
Parallel scanning Indexed storage
No inherent structure Simple data structure
Bulk writesHigh volume random reads
and writes
Batch Oriented Real-Time
![Page 9: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/9.jpg)
Agenda
• Big Data Overview
• Oracle NoSQL Database
• Architecture
• Technical Overview
• Benchmark Results
9 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Benchmark Results
![Page 10: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/10.jpg)
Oracle NoSQL Database Use Cases
SIMPLE QUERIES
DYNAMIC SCHEMA
Customer profile management
Social networks
Personalization
Click-through data processing
10 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
DYNAMIC SCHEMA
HIGH VOLUME DATA
High-throughput event processing
Sensor & statistics data capture
Authentication & Content management
Mobile application backend infrastructure
Archiving
![Page 11: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/11.jpg)
Example: On-line Ads and Content
Scenario
• User clicks on a web page
• Cookie used to look up user profile
• Store new profile if required
• User profile sent to expert system
• Appropriate ad placed on page
11 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
Important Attributes
• Fast response time and high throughput
• High availability and scalability
• Flexible data model
Goal: Optimize Internet Advertising to Increase RevenuesGoal: Optimize Internet Advertising to Increase Revenues
Ad to be
Displayed
Expert
SystemNoSQL
DB
Look Up
User Profile
![Page 12: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/12.jpg)
Customer-Driven Requirements
• Terabytes to petabytes of unstructured or semi-structured data
• No single point of failure
• Cost effective, distributed storage
• Scalable on commodity hardware
• Fast, predictable response to simple queries
12 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Fast, predictable response to simple queries
• Fast, reliable transactions
• Simple administration, enterprise support
• Commercial-grade NoSQL solution
• Real 24x7 support
• Real database expertise
• Large vendor & dedicated resources building & testing the software
![Page 13: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/13.jpg)
Oracle NoSQL Database A Distributed, Scalable Key-Value Database
Simple Data Model
Small, distributed footprint
Highly scalable, available
Application
NoSQLDatabase
Driver
Application
NoSQLDatabase
Driver
13 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
Highly scalable, available
Transparent load balancing
Integrates with Oracle Stack
Storage NodesDatacenter B
Storage NodesDatacenter A
![Page 14: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/14.jpg)
Architecture Summary
• Scalability• Dynamic data partitioning and distribution
• Optimized data access via intelligent driver
• High availability• One or more replicas
• Resilient to partition master failures
14 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Resilient to partition master failures
• No single point of failure
• Disaster recovery through location of replicas
• Transparent load balancing• Reads from master or replicas
• Driver is network topology & latency aware
• Optimized for high throughput and low latency
![Page 15: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/15.jpg)
Simple Data Model
• Simple data model – key-value pair (major+minor-key paradigm)
• Simple operations – read/insert/update/delete, RMW support
• Scope of transaction – records within a major key, single API call
• Unordered scan of all data (non-transactional)
15 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
userid
addresssubscriptions
email idphone #expiration date
Major key:
Minor key:
Value:
Strings
Byte Array �
![Page 16: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/16.jpg)
Simple Data ModelACID Transactions
• ACID transactions by default
• Transaction Scope
• Single API call
16 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Single API call
• All records must have the same major key
• Support for multiple operations within a transaction
• Can be relaxed for increased performance on a
per-operation basis
![Page 17: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/17.jpg)
Simple Data Model
ACID Transactions – Configurability
• Configurable Durability Policy
17 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Configurable Consistency Policy
![Page 18: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/18.jpg)
Simple Administration
• Web-based console and
CLI commands
• Manages and Monitors
• Topology
• Configuration changes
• Load: Number of operations,
18 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• Load: Number of operations,
data size
• Performance: Latency, throughput. Min, max,
average, trailing, …
• Events: Failover, recovery, load distribution
• Alerts: Failure, poor performance, …
![Page 19: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/19.jpg)
Oracle NoSQL Database Differentiation
Commercial Grade
Software and Support Simple Data ModelSimple
Administration
• General Purpose • Simple Major + •Web-based Console
Scalability and
Availability
• Intelligent Oracle
Integrates seamlessly with Oracle Stack (ODI, CEP, OLH)
19 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• General Purpose
• Reliable – Based
on proven Berkeley
DB JE HA
• Easy to Install &
Configure
• Simple Major +
Minor key and Value
data structure
• ACID transactions
• Configurable
consistency and
durability
•Web-based Console
and CLI commands
• Manages and Monitors: • Topology
• Load
• Performance
• Events
• Alerts
• Intelligent Oracle
NoSQL DB Driver• Evenly distributes Data
• Sends operation to
fastest node
• Bounded network hops
for all operations
• Automatic replication
and failover
![Page 20: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/20.jpg)
Benchmarking Results @ Cisco
• 1.6 billion records
• 94K insert/sec
20 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
• 25K read/update/sec
• Low latency
• Linear scalability
![Page 21: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/21.jpg)
Oracle NoSQL Database
�Easy to use, easy to manage
�Scalable, Available, Predictable Latency
21 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.
�A NoSQL Database from a vendor you trust
![Page 22: DOAG NoSQL Database Overview · PDF fileand CLI commands •Manages and Monitors: •Topology •Load •Performance •Events •Alerts NoSQL DB Driver •Evenly distributes Data](https://reader033.vdocuments.mx/reader033/viewer/2022051720/5a7885727f8b9a87198c86f3/html5/thumbnails/22.jpg)
22 Copyright © 2012, Oracle and/or its affiliates. All rights
reserved.