future trends and review - lecture 13 - introduction to databases (1007156anr)

2 December 2005

Introduction to DatabasesFuture Trends and Review

Prof. Beat Signer

Department of Computer Science

Vrije Universiteit Brussel

http://www.beatsigner.com

http://www.beatsigner.com/

Beat Signer - Department of Computer Science - [email protected] 2May 23, 2014

Current Trends

We have already seen object database management systems (ODBMS) as an alternative to relational database management systems (RDBMS)

Recently, the term NoSQL databases has been

introduced for different non-RDBMS solutions non-relational, horizontally scalable, distributed, ...

often ACID properties not fully guaranteed

- eventual consistency

many solutions driven by web application requirements

different classes of NoSQL solutions

- object databases (db4o, ObjectStore, Objectivity, Versant, ...)

- column stores (BigTable, Hbase, ...)

- document stores (CouchDB, MongoDB, ...)


Current Trends ...

different classes of NoSQL solutions

- key-value (tuple) stores (Membase, Redis, ...)

- XML databases (Tamino, BaseX, ...)

- ...


Column Stores

Solutions for large scale distributed storage systems very large tables with billions of rows and millions of columns

petabytes of data across thousands of servers

BigTable distributed storage solution for structured data used by Google

HBase distributed open source database (similar to BigTable)

part of the Apache Hadoop project

use MapReduce framework for processing

- map step

• master node divides problem into subproblems and delegates them to child nodes

- reduce step

• master mode integrates solutions of subproblems


Document Stores

Data no longer stored in tables

Each record (document) might have a different format

(number and size of fields)

Apache's CoucheDB is an example of a free

and open source document-oriented database


Cloud Computing

Online or web-based databases store data in the cloud or on servers on the internet

examples

- QuickBase, quickbase.intuit.com

- Blist, www.blist.com

Amazon SimpleDB distributed database written in Erlang

offers a Web Service API

makes uses of S3 and EC2

on demand scaling

non-relational data store

- schemaless

- hashtables with set of key value pairs


Mobile and Embedded Databases

Many everyday devices

contain databases TVs, washing machines,

mobile phones, ...

e.g. Android phones with SQLite database

Embedded databases in

cars, airplanes etc. manage configurations and

store sensor data

e.g. db4o object database used in BMW's Car IT system


Course Review

1. Introduction and Conceptual Modelling various DB application domains

basic DB terminology

data models and history of DBMS

conceptual modelling and the ER model

2. Extended ER Model and other Modelling Languages EER model

- specialisation and generalisation, ISA constraints, aggregation

OM and UML as alternative modelling techniques

3. Relational Model and Relational Algebra relational model

relational algebra

- fundamental, additional and extended operations


Course Review ...

4. Relational Database Design reduction

functional and multivalued dependencies

normal forms and normalisation

5. Structured Query Language (SQL) data definition language (DDL)

data manipulation language (DML)

6. Advanced SQL authorisation

SQL programming environments

- ESQL, SQL/CLI, SQL/PSM and triggers

impedance mismatch


Course Review ...

7. DBMS Architectures and Features components of a DBMS

different DBMS architectures

- teleprocessing, two-tier and N-tier architectures, SOA, cloud computing, ...

- distributed DBMS, parallel DBMS, TP Monitor, ...

8. Storage Management storage device hierarchy and RAID systems

buffer management

record formats and operations

9. Access Methods indexing

- sparse, dense and multilevel indices, B+-trees, bitmap index

hashing


Course Review …

10.Query Processing and Optimisation query processing and query costs

selection, sorting, join, ...

basic query optimisation

11.Transaction Management transactions

- conflict serialisability

concurrency

- lock-based, timestamp ordering and optimistic

recovery

12.Object Databases impedance mismatch, object and object-relational databases

OODB Manifesto, ODMG Standard


Course Review …

Access

Methods

System

Buffers

Authorisation

Control

Integrity

Checker

Command

Processor

Program

Object Code

DDL

Compiler

File

Manager

Buffer

Manager

Recovery

Manager

Scheduler

Query

Optimiser

Transaction

Manager

Query

Compiler

Queries

Catalogue

Manager

DML

Preprocessor

Database

Schema

Application

Programs

Database and

System Catalogue

Database

Manager

Data

Manager

DBMS

Programmers Users DB Admins

Based on 'Components of a DBMS', Database Systems,

T. Connolly and C. Begg, Addison-Wesley 2010


Covered Book Chapters

The following chapters of the Database

System Concepts book have been covered

and should be studied chapter 1

- Introduction

chapter 2

- Relational Model

chapter 3

- Introduction to SQL

chapter 4

- Intermediate SQL

chapter 5

- Advanced SQL


Covered Book Chapters ...



and should be studied chapter 6.1

- Relational Algebra

chapter 7

- Database Design and the ER Model

- Reduction to Relational Schemas

- Unified Modelling Language (UML)

chapter 8

- Relational Database Design

chapter 10

- Storage and File Structure






- Indexing and Hashing

chapter 12

- Query Processing

chapter 13

- Query Optimization

chapter 14

- Transactions

chapter 15

- Concurrency Control






- Recovery System

chapter 17

- Database-System Architectures

chapter 22

- Object-Based Databases


Exam

Written closed book exam in English covers content of lectures, specific book chapters

and exercises

Current exam date: June 10 room D0.02

14:00-18:00

Questions about the course content? block hours on June 2, 09:00-12:00 and 13:00-16:00

- Reinout Roels, 10 G 730

send and email to your assistant to get an appointment


Exam Format

The exam will contain a number of questionsaddressing different parts of the lectureand exercises

Make sure that you understand the general concepts we will ask less about specific details

Possible topics include but are not limited to define a conceptual model (ER) for a given description of an

application domain

reduction of an (E)ER model to a relational model

given a database schema and some questions about specific content

- write the corresponding SQL queries

transform an SQL query to a relational algebra expression


Exam Format ...

given a number of relations

- write specific relational algebra queries

given a relation R

- find functional/multivalued dependencies

- check normal forms

given two relations with specific properties

- worst case estimates for different kinds of operations (e.g. join)

given an SQL query

- define the query expression/execution tree

given a query expression tree and some indices

- optimise the query expressions tree

given a schedule S

- check if S is conflict serialisable

...


Exam Format ...

You should further have a good understanding

of the general concepts introduced in the lecture

since there might be essay questions asking you to

explain a concept or to compare two or more concepts

or solutions


Erasmus+

Study a semester abroad at top European universities 3rd Bachelor year and Master

General courses or specialisation in areas not offered at

the VUB (e.g. security)

Opportunity to widen your horizon

Explicitly mentioned on your final diploma

[http://wise.vub.ac.be/erasmus/]

Chalmers University of Technology,

SwedenÉcole Polytechnique Fédérale de

Lausanne, Switzerland

ETH Zurich,

Switzerland

Technische Universität München,

Germany

Universitat Politécnica de Catalunya,

Spain


Other Courses

Web Information Systems (4011474FNR) evolution of the Internet and Web Information Systems (WIS)

basic technologies (e.g. HTTP) and Web architectures

Web 2.0, semantic web, Web search (e.g. Google PageRank)

security, privacy and trust

[http://wise.vub.ac.be/content/web-information-systems]

Advanced Topics in Information Systems (4016792ENR) seminar about recent developments in information systems

internet of things, cloud computing, mashups, web search, post-relational databases, web of data, information visualisation, information system interaction, human-computer interaction, ...

[http://wise.vub.ac.be/content/advanced-topics-information-systems]

WEB & INFORMATIONSYSTEMS ENGINEERING


Other Courses ...

Next Generation User Interfaces (4018166FNR) general HCI introduction

multimodal interaction (theoretical concepts, fusion and fission, ...)

adaptation

pen-based interaction

tangible interaction and augmented reality

[http://wise.vub.ac.be/content/next-generation-user-interfaces]

Open Information Systems (4014887FNR) information integration

RDF and the semantic web

ontologies

semantic desktops

linked data



01001000100

0101001100010010100010010

0100100010010001000100001001000

100010001100001001000110010101010110

1100010010100010010010010100010101011001

101001100001100 101010100

00101000100 110101010101

00100 01010101000

1001 1111111111

111 0000000010

0 11111111

0101001011

010101010

111010101

001010010110

Fluid Cross-Media Information Spaces


Prof. Dr. Beat SignerInteractive Paper, Cross-Media

Information Architectures

Dr. Bruno DumasMultimodal Interaction, Cross-

Media Information Architectures

Lode HosteMultimodal Interaction, Midas

and Mudra Framework

CISA

Human-Machine &

Human-Information

Interaction

Information

Systems &

Management

Information

Visualisation

& Navigation


CROSS-MEDIA INFORMATION SPACESAND ARCHITECTURES (CISA)

Sandra TrullemansPersonal Cross-Media

Information Management


Reinout RoelsMindXpres: Extensible Content-

driven Presentation Tool

Ahmed A.O. TayehOpen Cross-Media Authoring,

Fluid Document Formats


CISA

Human-Machine &

Human-Information

Interaction

Information

Systems &

Management

Information

Visualisation

& Navigation

CROSS-MEDIA INFORMATION SPACESAND ARCHITECTURES (CISA)


PARC User Interface (Mid 70s)

Desktop metaphor

WIMP interaction

"filing cabinets" with

hierarchical folders

Paper paradigm

"What You See Is What

You Get" (WYSIWYG)

what about richer

document formats that

existed at that time?Xerox Star 8010 [http://www.digibarn.com/collections/systems/xerox-8010/]


What is Wrong with Digital Documents?

Existing document formats are based on the simulation

of paper affordances on desktop computers

How to manage mixed-media "documents" in open and

fluid cross-media information spaces? on the data level

- context-sensitive adapatation

- cross-media transclusion

on the visualisation and navigation level

- zoomable user interfaces

on the cross-media interaction level

- fluid multimodal cross-media interfaces

Remediation of the "paper simulation" approach WYSIWYG is only one out of many options!

CISA

Human-Machine &

Human-Information

Interaction

Information

Systems &

Management

Information

Visualisation

& Navigation


RSL Metamodel and iServer

Global Information Systems Group, ETH Zurich


Links

Users

LayersPlug-ins

Structure

Active

Content

Global Information Systems Group, ETH Zurich


Bridging the Paper-Digital Divide


Paper-Digital Integration

Amazon Kindle Anoto Digital Pen and Paper Technology

Augmented / Interactive PaperElectronic Paper


Interactive Paper Applications

Enhanced Reading

paper-digital maps

interactive festival brochures

educational materials

auction brochures

scientific publications

…

Enhanced Writing

photo album

researcher's notebook

mammography annotation

query by sketching

…

Paper-based Interfaces

PaperPoint

document proof-editing

digital libraries

video analysis tool

educational games

Art Installations

Lost Cosmonaut

Generosa Enterprise

Interactive Tabletops

photo browser

collaborative sketch tool


Interactive Festival Guide (EdFest)

Global Information Systems Group

ETH Zurich


PaperPoint Presentation Tool

Mobile PowerPoint

presentation tool

non-linear presentations

real-time annotations

digital whiteboard

...

Multi-pen support

brainstorming

Global Information Systems Group

ETH Zurich


Paper-Digital Maps

Szabolcs Becze


RSL-based Associative File System

signer

My Pictures

Vancouver ER 2010

Granville

Island

Vancouver

Harbour

Public

Market

Keynote

J. Thorp

Olga and

Lamia

Dinner

ER 2010

multiple classification

structural link

navigational link

My Videos

Vancouver

Aquarium

ER 2010

Keynote

cross-media association

My Presentations

ER 2010 WISE 2009

cross-media

transclusion

single slide

transclusion

(via OOXML

RSL selector)

Gregory Cardone


RSL-based Associative File System ...

Gregory Cardone


Personal Information Management (PIM)

Keeping, organising and

re-finding information

digital and physical

Investigating user-

information interaction

Conceptual PIM model

(based on RSL)

Cross-media PIM system

document tracking

context model

...Sandra Trullemans


What is Wrong with Slideware?

Simulation of physical slides limited space due to the slide concept

linear navigation from slide to slide

difficult to reuse content and embed rich media types

MindXpres addresses these issues unlimited canvas with zoomable user interface

non-linear navigation and associative linking

content-based approach with automatic visualisation


MindXpres Presentation Tool

HTML5-based extensible

core with three types of

JavaScript plug-ins

components

- source code, graph, video, ...

containers

- slide, image gallery, ...

structures

- grid, graph, clustered, ...

Presentation as RSL-

based overlay structure

enables navigation across

multiple presentationsReinout Roels


MindXpres Presentation Tool ...

Reinout Roels


MindXpres Presentation Tool ...

Functional MindXpres prototype

Ongoing work visual authoring tool

- alternative to XML-based authoring

rich media plug-ins

- videos with subtitles, annotations etc.

- statistical data with alternative visualisations

- live sensor data

- ...

audience-driven presentations

collaborative annotations and information sharing

multimodal interaction (e.g. integration of PaperPoint concepts)

import of existing slideware formats


ArtVis

Advanced visualisation

techniques in combination

with a TUI

explore Web Gallery of Art

faceted browsing

Phidgets-based TUI

RFID-tagged physical

objects

Three main components

to explore, analyse and

browse the information

Bram Moerman


ArtVis ...

Bram Moerman


Video: ArtVis

Bram Moerman


Multimodal and Multi-Touch Interaction

EPOC, emotiv Echo Smartpen, Livescribe

Kin

ect, M

icro

soft


Midas/Mudra Framework declarative definition of multimodal

and multi-touch interactions

rule-based language approach

rapid protoyping and application development

iGesture Workbench create and test gesture sets and algorithms

different modalities: digital pen, Wii remote, …

open source (www.igesture.org)

HephaisTK Toolkit domain-specific human-computer dialogue

language (SMUIML) for multimodal I/O

speech recognisers, RFID readers, …

Multimodal and Multi-Touch Interaction


Home Automation / Office of the Future


SpeeG2

User

Speech recognition

(Microsoft SAPI 5.4)

Skeletal tracking

(Microsoft Kinect)

5

4

2

3

SpeeG2 GUI

6

1

Sven De Kock


Video: SpeeG2 Performance (21 WPM)

Sven De Kock


Video: Kinect Presenter


Video: Augmented Reality (Mental Nomad)

Toon Duwee


Student Projects

Interactive paper and augmented reality various apprenticeships and thesis proposals in the

area of interactive paper and augmented reality

Multimodal and Multi-touch Interaction next generation text input devices (e.g. combine voice and Kinect)

multimodal mobile interaction

Cross-Media Information Spaces and Architectures fluid cross-media document formats

MindXpres presentation tool, office of the future, PIM, ...

If you should be interested in one of these topics

(or if you have your own ideas) please contact us! http://wise.vub.ac.be/thesis_proposals


References

A. Silberschatz, H. Korth and S. Sudarshan,

Database System Concepts (Sixth Edition),

McGraw-Hill, 2010

Thesis Projects (Bachelor and Master) ... http://wise.vub.ac.be/thesis_proposals

Cross-Media Information Spaces and Architectures http://wise.vub.ac.be/content/cross-media-information-

spaces-and-architectures

Interactive Paper and Augmented Reality http://wise.vub.ac.be/content/interactive-paper-and-

augmented-reality


References

Multimodal and Multi-Touch Interaction http://wise.vub.ac.be/content/multimodal-and-multi-

touch-interaction

2 December 2005

The End

Good Luck with the Exam!

future trends and review - lecture 13 - introduction to databases (1007156anr)

Education

computer science

signer department

document stores data

distributed dbms

db4o object database

structured data

databases tvs

webbased databases store