semantic data chapter 9 : data integration and ontology...

61
Semantic Data Chapter 9 : Data integration and ontology-based data access Jean-Louis Binot 1 01/04/2020 Semantic Data

Upload: others

Post on 21-Jun-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Semantic Data

Chapter 9 : Data integration and ontology-based data access

Jean-Louis Binot

1 01/04/2020Semantic Data

Page 2: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Sources and recommended readings

2

Page 3: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Agenda

3

Graph DBs and triple stores3

RDBMS and data integration challenges2

RDF-based data integration1

Case Study in Oil & Gaz4

Ontology based data access5

Page 4: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Oil and Gaz data context

4

Page 5: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

A data integration example : EPIM

5

Page 6: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Solution architecture: RDF database for data integration

6

Page 7: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Solution : RDF database for data integration

7

Page 8: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Background questions

8

Page 9: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Agenda

9

Graph DBs and triple stores3

RDBMS and data integration challenges2

RDF-based data integration1

Case Study in Oil & Gaz4

Ontology based data access5

Page 11: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

The IT environments

11

Page 12: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

What do we find in production?

12

Page 13: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Performance and velocity challenges in production

13

Page 14: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Operational complexity

❑14

Live data

?

Page 15: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Is OLAP the solution for data ?

15

Page 16: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

RDBMS challenges summary

16

Page 17: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Integration challenges : data silos

17

Page 18: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Silo issues summary

18

Page 19: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Agenda

19

Graph DBs and triple stores3

RDBMS and data integration challenges2

RDF-based data integration1

Case Study in Oil & Gaz4

Ontology based data access5

Page 20: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

NoSQL databases

20

Page 21: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Aggregate NoSQL databases

Value

21

Page 22: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Aggregate NoSQL databases

22

Page 23: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Graph databases

23

Page 24: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Graph databases versus RDF triple stores

24

Page 25: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Graph databases versus RDF triple stores

25

Page 26: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Implementation of RDF stores

Subject Predicate Object

26

Page 27: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Implementation of RDF stores ./.

Subject Predicate Object

27

Dictionary

Page 28: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

A ranking of graph databases and RDF stores

28

Page 29: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

The main commercial systems are also active

29

Page 30: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Reasoning with RDF stores

30

Page 31: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Agenda

31

Graph DBs and triple stores3

RDBMS and data integration challenges2

RDF-based data integration1

Case Study in Oil & Gaz4

Ontology based data access5

Page 32: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

What do we mean by a case study ?

32

Page 33: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Statoil: case study paper

33

Page 34: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Looking at the abstract

34

Page 35: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

The problem

-

-

-

35

Page 36: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Business needs

❑ ∈

36

Page 37: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Existing situation: architecture and data

37

Page 38: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

38

Page 39: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Existing situation : p

39

Page 40: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Solution architecture : ontology-based data access

40

Page 41: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Solution implemented: innovative aspects

41

Page 42: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Evaluation

42

Page 43: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Agenda

43

Graph DBs and triple stores3

RDBMS and data integration challenges2

RDF-based data integration1

Case Study in Oil & Gaz4

Ontology based data access5

Page 44: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

OBDA main ideas

DB3

44

Page 45: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

OBDA main ideas ./.

45

Page 46: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Differences between OBDA and databases

46

Page 47: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

A quiz

◼ ⊆

◼ ⊆ ⊓

◼ ∃ ⊤ ⊆

◼ ⊆ ∃ ⊤

Database ABox OntologyQuery

NonBelgianUniv(Oxford)

Student(André)

University(ULiège)

Institution ⊓ ¬University(KUL) Yes Don’t Know Don’t Know

No Don’t Know Yes

No Don’t Know Yes

Yes Yes Yes

47

Page 48: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Questions to be adressed

48

Page 49: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Choices of languages

∃ ∧ ∧

❑ Ԧ𝑥 ∃ Ԧ𝑦 φ Ԧ𝑥 Ԧ𝑦

◼ φ Ԧ𝑥 Ԧ𝑦

Ԧ𝑥 or Ԧ𝑦

◼ x y

◼ x,

49

Page 50: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Choices of languages ./.

50

Page 51: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Ontology language for OBDA : OLW 2 QL / DL Lite

⊆ NLOGSPACE ⊆ ⊆ ⊆ ⊆ ⊆ EXPSPACE

51

Page 52: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

DL Lite logics

◼ ∃ ∃

◼ ⊆ ⊓

◼ ⊆

◼ ⊆

◼ ⊆

52

Page 53: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Certain answers

❑ O Ԧ𝑥 OO

Ԧ𝑥 Ԧ𝑥 Ԧ𝑥 O

O ⊨ Ԧ𝑥

I I ⊨ O→ I ⊨ Ԧ𝑥

53

Page 54: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Dealing with the TBox

A T ⊆ ∀

54

Page 55: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Classical approach for dealing with the TBox: query rewrite

O T A

r, T T

u

❑ uT

q

T

55

Page 56: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Example of query rewriting from the case study

⊆ ∃

❑ Query rewriten qr :

56

Page 57: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Example of query rewriting from the case study

57

Page 58: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

OBDA status

58

Page 59: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

Summary

59

Page 61: Semantic Data Chapter 9 : Data integration and ontology ...binot/INFO8005/Theory/Semantic-data-c… · Agenda 9 3 Graph DBs and triple stores 2 RDBMS and data integration challenges

THANK YOU

61