€“neo4j, orientdb ... node.js java rest xcc odbc interfaces evaluator ... performance at scale...

29
www.informatik-aktuell.de

Upload: habao

Post on 19-Apr-2018

234 views

Category:

Documents


1 download

TRANSCRIPT

www.informatik-aktuell.de

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED.

Warum NoSQL? Mario Briana – Solution Architect

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 2

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 3

Relationale Datenbanken …

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 4

Schema beim Schreiben & Lesen

Normalisierung um Redundanzen zu vermindern

– 1:1, 1:Many, Many:Many

Objekt-relationale Unverträglichkeit

– Daten Objekte

Neue Daten => neues Modell

Skalierbarkeit

Relationale Datenbanken

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 6

Dokumentenmodell – hierarchische Baumstruktur

Profile

Name Contact Info

Email

Experience

Company Position

Job

Name

State

Recommendation

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 7

ID MEMBER_NAME AGE ORG_ID

12 Grady Booch 59 442

133 Neeraj Gupta 23 934

348 Jose Cordova 37 115

ID ORG_SHORT_NM ORG_FULL_NM ORG_TYPE

ORG_STATE

115 Sun Sun Microsystems corporation 09

442 IBM CE Lab International Business M… corporation 22

934 Stanford Stanford University Educational 09

ID ST_ABBR ST_NAME

09 CA California

22 HI Hawaii

33 TX Texas

In welchem Staat wohnt Grady Booch?

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 8

Heterogene Daten sind eine echte Herausforderung

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 9

NoSQL Datenbanktypen

Key-Value

– Amazon Dynamo, Riak

Dokumentenorientierte

– MarkLogic, CouchDB, MongoDB

Graphen

– Neo4j, OrientDB

Spaltenorientierte

– Cassandra, BigTable, SimpleDB

<profile>

<name>Grady Booch</name>

<contact-info>

<email>[email protected]</email>

<email>[email protected]</email>

</contact-info>

<experience>

<job current=“true”>

<company>

<name>IBM CE Lab</line1>

<state>HI</zip>

</company>

<position>IBM Fellow</position>

<recommendation>Grady is awesome</recommendation>

</job>

</experience>

</profile>

In welchem Staat wohnt Grady Booch?

Dokumente sind “human readable” (xml)

{

"profile": {

"name": "Grady Booch",

"contactInfo": {

"emails": ["[email protected]", "[email protected]"]

},

"jobs": [{

"current": true,

"company": {

"name": "IBM CE Lab",

"state": "HI"

}

"position": "IBM Fellow",

"recommendation": "Grady is awesome"

}]

}

}

In welchem Staat wohnt Grady Booch?

Dokumente sind “human readable” (json)

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 12

The Beauty of NoSQL

Flexibles

Datenmodell

Einlesen der Daten

(Ingest “as is”)

Suchen und Abfragen

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 13

Iterativer Prozess

Suchen & Abfragen Ingest “as is”

Anwendung

MarkLogic ist “Schema flexibel”

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 14

The Only Enterprise NoSQL Database

ACID Transaktionen

Hochverfügbarkeit und Disaster Recovery

Horizontale Skalierbarkeit und Elastizität

Sicherheit

Skalierberakeit und Elastitzität

Semantische Daten

Cloud Verfügbarkeit

SEARCH DATABASE

APPLICATION SERVICES

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 15

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 16

Situation “vor MarkLogic”

PDF

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 17

Situation “Mit MarkLogic”

PDF

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 18

MarkLogic Architecture

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 19

Semantics

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 20

Semantics: A New Way to Organize Data

Data is stored in Triples, expressed as: Subject : Predicate : Object

John Smith : livesIn : London

London : isIn : England

Query with SPARQL, gives us simple lookup .. and more

Find people who live in (a place that's in) England

"John Smith" "England" livesIn

"London" isIn

livesIn

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 21

Context from the World at Large

“Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”

Linked Open Data

– Facts that are freely available

– In a form that’s easily consumed

DBpedia (wikipedia as structured information)

– Einstein was born in Germany

– Ireland’s currency is the Euro

GeoNames

– Doha is the capital of Qatar

– Doha has these lat/long coordinates

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 22

SCALE OUT

ARCHITECTURE

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 23

MarkLogic Architecture

Java REST XCC ODBC Node.js Interfaces

Evaluator JavaScript | XQuery | XSLT | XPath | SQL | SPARQL

Cache Expanded Tree Cache | Module Cache

Broadcaster / Aggregator

Evaluation Layer

Transaction Controller Multiversion Concurrency Control

Cache Compressed Tree Cache | List Cache

Indexes Values | Structure | Text | Scalar | Metadata | Security | Geospatial | Reverse | Triple

Compressed Storage JSON | XML | Binary | Text

Transaction Journal

Data Layer

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 24

Cluster Topologies XA

RDBMS

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 25

Tiered Storage With Tiered Storage, you can…

Define data tiers based on a range index

Have content balanced into forests by tier

Move an entire tier to different storage

Attach a tier to a different database

Query one database on one tier…

…or the other database on the other tier…

…or both at once

All with no downtime, and 100% consistency

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 26

© COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED. SLIDE: 27

Wichtige links Partner Tool Kit http://www.marklogic.com/partners/partner-toolkit

Überblick, Datenblätter, case studies, White papers, Produktinformationen etc.

Kostenloser Download für Entwickler http://developer.marklogic.com/

Referenzen http://de.marklogic.com/customer-type/testimonials/

Consulting & Services http://de.marklogic.com/services/consulting-services/

Videos zu NoSQL: https://www.youtube.com/watch?v=npWXpnSmqNc (15 Min.)

https://www.youtube.com/watch?v=YJs0RUNtOu0 (5 Min.)

Social Network https://www.xing.com/companies/marklogic

https://www.linkedin.com/company/21238?trk=tyah&trkInfo=clickedVertical%3Acompany%2CclickedEntityId%3A21238%2Cidx%3A2-1-2%2CtarId%3A1440496966926%2Ctas%3AMarkLogic

Geospatial

Support

Full-text

Search Flexible

Indexes

Native

JSON

Store

Native

XML

Store

Real-time

Alerting

Native RDF

Triple Store

Bitemporal

Tiered

Storage

Fully

Transactional

Server-side

JavaScript

Hadoop

and HDFS

Cloud

Ready

(AWS)

SQL

Support

Scalable

and Elastic

MarkLogic

Content Pump

REST

API

Samplestack

Ad-hoc

Queries

Schema

Agnostic

XA

Transactions

24/7

Engineering

Support

LDAP and

Kerberos

Security

Security

Certifications

Configuration

Management

Monitoring and

Management

Performance

at scale

Customizable

Failover

Customizable

Backup

Atomic

Forests

Point-in-time

Recovery

ACID

Transactions

Index Across

Data Types

Flexible

Replication

Semantic

Inference

Multi-OS

Support

POWERFUL AGILE TRUSTED

MarkLogic / Enterprise NoSQL Database Platform

WHAT WILL YOU REIMAGINE?