open source data warehousing

Expert session

June 17th, 2010

Agenda •  Introduction •  QUIPU presentation

–  Background –  Architecture –  Future plans –  More info

•  QUIPU demo •  Q&A •  Drinks

Introduction •  Our highly appreciated guests…

Introducing the QUIPU team •  Juan-José van der Linden •  Michael Heymans •  Peter Kurstjens •  Jeroen Klep

•  BI strategy developement •  Information analysis •  (E)DW architecture •  Project management •  Adapttm training

•  Maintenance & support •  Data vault technology •  Quipu development

Customers

QUIPU: Open Source DW generation •  Open Source Data Warehouse Generation System, based on

Data Vault principles •  First public release planned for July 1st 2010 •  QOSQO takes a leading role in continuous development and

support

What is Quipu about? •  Fast implementation of DV based EDWH •  Reduction of risk of modeling errors •  Removal of repetitive tasks •  Lowering TCO

Benefits •  Automated data warehouse data model design

and implementation •  Lower total cost of ownership using open source

licensing model •  Fully repository based metadata driven data

model and load code generation •  Supports most common database platforms using

ANSI-SQL over JDBC

Characteristics

QUIPU GUI

QUIPU BACK-END

Hudson

Redmine

Subversion

Source(s) Target DW

Repo

Templates

Repository structure

Connections

Dialects

Models

loggin

g

sched

ulin

g

Sec

urity

QUIPU

Source 1

Source 2

Source n

Data Warehouse (Business Data Vault)

DM 1

DM 2

DM 3

T ETL Tool

LOAD TL

Generate DV Model

Generate Load

Generate DM’s

Generate TL Modeling

Tool

Scheduler

Logging / Monitoring

Quipu basic architecture: ‘classic’

QUIPU

Source 1

Source 2

Source n

sDV 1

sDV 2

sDV n

bDV

DM 1

DM 2

DM 3 T

LOAD

ETL Tool

DM 1

DM n

DM 2

DM 3

TL

Generate DV Model

Generate Load

Generate DM’s

Generate TL

Generate DV Model

Generate Load

Generate DM’s

Generate TL

Scheduler Logging / Monitoring

Quipu extended architecture

DM 3

LOAD

TL

QUIPU

Source 1

Source 2

Source n

bDV

sDV 1

sDV 2

sDV n

DM 3

T

LOAD

DM 1

DM n

DM 2

Generate DV Model

Generate Load

Generate DM’s

Generate TL

Scheduler

Logging / Monitoring

Quipu extended architecture / 2

T

TL

DM 3

QUIPU

T

Generate DV Model

Generate Load

Generate DM’s

Generate TL

Scheduler

Logging / Monitoring

Quipu Repository

T

Quipu Repository

Source n

Future plans •  Community Edition

–  Enhancements •  Data mart generation •  Scheduling •  ??

–  Paid add-ons –  Customer request based –  Community request based

•  Enterprise Edition –  Completely new product –  Support for multiple versions, models, customers, users

QUIPU EE

QUIPU version management

DM 1

DM 2

Version x

LOAD TL

Generate DV Model

Generate Load

Generate DM’s

Generate TL

Scheduler

Logging / Monitoring

Quipu Enterprise Edition

Quipu Repository

Multiple DW / Project / Version Management / DTAP / Customer

More info

•  www.QOSQO.nl •  www.datawarehousemanagement.org

!Download available per July 2nd 2010

•  Launch event July 1st, 2010, Vught •  OS_Quipu

QOSQO, the DataVault specialist, is the leading company behind Quipu www.QOSQO.nl

Our sister company Nippur assists in executing business intelligence projects www.nippur.nl

Karel Doormanlaan 1b 5688 BP OIRSCHOT The Netherlands E: info@QOSQO.nl T: +31 ( 0499 ) 577 562 F: +31 ( 0499 ) 577 059 open source data warehousing