sns practice: generating etl
TRANSCRIPT
SNS practice: Generating ETL
Maarten Ketelaars
Data Architect
2
Agenda
� Introduction SNS Bank
� ICT strategy
� DWH framework & tooling
� Data VaultTM modeling
� ETL-procedure
� Modeling deliverables & procedure
� Advantages
� Further developments
3
Introduction SNS Bank
� Create financial resources for individuals and companies
� Focus on innovative products and services
� Mortgages
� Asset accrual and protection
� Key figures 2003
� Employee 3400
� Profit E 129 Million
� Balance sheet E 38,5 Billion
4
Introduction SNS Bank
� Create financial resources for individuals and companies
� Focus on innovative products and services
� Mortgages
� Asset accrual and protection
� Key figures 2003
� Employee 3400
� Profit E 129 Million
� Balance sheet E 38,5 Billion
5
ICT strategy
� Standardisation
� Development environments
� Infrastructure components
� Application-integration
� Solutions
� Re-use -- Buy -- Build
� Open Systemarchitecture / Open standards
� No vendor lock-in
� Business-ICT alignment (developments in ICT & Business translate to changes in standards & directions)
6
DWH framework
Data exploitationData storageData extraction
Data Staging
InterfaceData Mart 1
Operational Data Store
Analysis
StandardReport
Data Warehouse
Ad-hocquestions
Interface
SourceSystem
Data Mart 2
Data Mart 3
Data Mart 4
Analysis
Report
Ad-hocquestions
Operational
TacticalS
trategical
Metadata management
Maintenance
Infrastructure
Organisation
SourceSystem
SourceSystem
ExternalSource
Operational
7
Tooling
Data exploitationData storageData extraction
Data Staging
InterfaceData Mart 1
Operational Data Store
Analysis
StandardReport
Data Warehouse
Ad-hocquestions
Interface
SourceSystem
Data Mart 2
Data Mart 3
Data Mart 4
Analysis
Report
Ad-hocquestions
Operational
TacticalS
trategical
Metadata management
Maintenance
Infrastructure
Organisation
SourceSystem
SourceSystem
ExternalSource
Operational
8
Tooling
Data exploitationData storageData extraction
Data Staging
InterfaceData Mart 1
Operational Data Store
Analysis
StandardReport
Data Warehouse
Ad-hocquestions
Interface
SourceSystem
Data Mart 2
Data Mart 3
Data Mart 4
Analysis
Report
Ad-hocquestions
Operational
TacticalS
trategical
Metadata management
Maintenance
Infrastructure
Organisation
SourceSystem
SourceSystem
ExternalSource
Operational
9
Tooling
Data exploitationData storageData extraction
Data Staging
InterfaceData Mart 1
Operational Data Store
Analysis
StandardReport
Data Warehouse
Ad-hocquestions
Interface
SourceSystem
Data Mart 2
Data Mart 3
Data Mart 4
Analysis
Report
Ad-hocquestions
Operational
TacticalS
trategical
Metadata management
Maintenance
Infrastructure
Organisation
SourceSystem
SourceSystem
ExternalSource
Operational
10
Data Vault™ DWH model (1)
• 3 NF+Timestamps (80’s)
• Dimensional modelling (90’s)
• Data Vault TM (since 2000)
� detail oriented
� historical tracking
� uniquely linked
� set of normalized tables
� Hybrid approach encompassing the best of breed between 3NF and dimensional modelling.
� Dan Linstedt : www.danlinstedt.com
11
Data Vault™ DWH model (2)
� Hub
� Table carrying a unique list of business keys, representing a
business component
� Link
� Represents the relation or transaction between two or more
business components
� Satellite
� Context information about Hubs or Links.
� Information is subject to change over time
12
Data Vault™ DWH model (3)
� Complementary choices SNS
� Satellites
� State satellite. Validation of hubs & links
� Information satellite. Specific properties of hubs and links, stored
in attributes
13
Data Vault™ DWH model (4)
Rekening kantoor v an opening status
Rekening statusRekening kantoor van inschrijv ing status
Rekening rekeningsoort status
Rekeningsoort
ID RekeningsoortRekeningsoortnummerBanknummer Bank
INTEGERINTEGERINTEGER
Link Rekeningsoort Rekening
ID RekeningsoortID Rekening
INTEGERINTEGER
Rekening
ID RekeningRekeningnummer
INTEGERDECIMAL(10)
Link rekening kantoor van inschrijv ing
ID RekeningID Kantoor
INTEGERINTEGER
Rekeningsoort Status
ID RekeningsoortRekeningsoort indicatorBegindatum rekeningsoortEinddatum rekeningsoort
INTEGERSMALLINTINTEGERINTEGER
Rekeningsoort Informatie
ID RekeningsoortBegindatum rekeningsoortEinddatum rekeningsoortIndicator zakeli jk productIndicator leningMethode maximum debetstandWTK product coderingNaam rekeningsoortKorte naam rekeningsoort
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
Rekening compensatielimiet
ID RekeningAgenderingsnummerBegindatum rekeningEinddatum rekeningCompensatielimietbedrag
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
Rekening betaalruime
ID RekeningAgenderingsnummerBegindatum rekeningEinddatum rekeningBetaalruimte
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
Rekening saldo
ID RekeningBegindatum rekeningEinddatum rekeningSaldo rekening
INTEGERINTEGERINTEGERDECIMAL(11,2)
Rekening informatie
ID RekeningBegindatum rekeningEinddatum rekeningBedrag Kredietl imietSaldocompensatieBlokkeringsindicatorWTK coderingDatum opening rekeningDatum afbetaaldDatum herleefd
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
Kantoren
ID KantoorBanknummer BankKantoornummer
INTEGERINTEGERINTEGER
Link rekening kantoor v an opening
ID RekeningID Kantoor
INTEGERINTEGER
14
Data Vault™ DWH model (5)DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STS
RST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNO
REK_IDKAN_ID
INTEGERINTEGER
DWL_KNI
REK_IDKAN_ID
INTEGERINTEGER
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
15
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STS
RST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
Data Vault™ DWH model (6)
DWS_RST_STSRST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_RST
RST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
16
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STS
RST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
Data Vault™ DWH model (7)DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWH_KAN
KAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNO
REK_IDKAN_ID
INTEGERINTEGER
DWL_KNI
REK_IDKAN_ID
INTEGERINTEGER
DWH_REKREK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWL_REK_RST
RST_IDREK_ID
INTEGERINTEGER
DWH_RST
RST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
17
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STS
RST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
Data Vault™ DWH model (8)
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
18
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STS
RST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
Data Vault™ DWH model (9)
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
19
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STS
RST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNO
REK_IDKAN_ID
INTEGERINTEGER
DWL_KNI
REK_IDKAN_ID
INTEGERINTEGER
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLD
REK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INA
REK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLM
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RST
RST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INA
RST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
Data Vault™ DWH model (10)
DWH_REK
REK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
20
Data Vault™ DWH model (11)
� Hubs & Links: Type 0
� Satellites: Type 2
� Begindate
� Enddate
�99991231
� Transaction-satellite: Type 0
21
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STSRST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REKREK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INAREK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLMREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTRREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INARST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
ETL-procedure
Table Table
Table
Table
Table Table
Table Table
Table
Staging
DV DWH
22
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STSRST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REKREK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INAREK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLMREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTRREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INARST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
ETL-procedure
Table Table
Table
Table
Table Table
Table Table
Table
Staging
DV DWH
P_Table
Proces
23
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STSRST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REKREK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INAREK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLMREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTRREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INARST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
ETL-procedure
Table Table
Table
Table
Table Table
Table Table
Table
Staging
DV DWH
P_Table
Proces
View
24
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_RST_STS
DWS_RST_STSRST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REKREK_IDREK_NR
INTEGERDECIMAL(10)
DWS_REK_SLDREK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INAREK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLMREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTRREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INARST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
ETL-procedure
Table Table
Table
Table
Table Table
Table Table
Table
Staging
DV DWH
P_Table
Proces
View
25
DWS_KNO_STS
DWS_KNI_STS
DWS_REK_STS
DWS_REK_REK_STS
DWS_REK_RST_STS
DWS_RST_STSRST_IDRST_INDRST_BEG_DATRST_END_DAT
INTEGERSMALLINTINTEGERINTEGER
DWH_KANKAN_IDBNK_NRKAN_NR
INTEGERINTEGERINTEGER
DWL_KNOREK_IDKAN_ID
INTEGERINTEGER
DWL_KNIREK_IDKAN_ID
INTEGERINTEGER
DWH_REKREK_IDREK_NR
INTEGERDECIMAL(10)
DWL_REK_REKREK_IDREK_ID_HFDREK_REK_COD
INTEGERINTEGERSMALLINT DWS_REK_SLD
REK_IDREK_BEG_DATREK_END_DATREK_SLD_BDR
INTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_INAREK_IDREK_BEG_DATREK_END_DATREK_KLM_BDRREK_SCP_INDREK_BLK_INDREK_WTK_CODREK_OPR_DATREK_AFB_DATREK_HRL_DAT
INTEGERINTEGERINTEGERDECIMAL(11,2)SMALLINTSMALLINTSMALLINTINTEGERINTEGERINTEGER
DWS_REK_CLMREK_IDREK_ANRREK_BEG_DATREK_END_DATREK_CLM_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWS_REK_BTR
REK_IDREK_ANRREK_BEG_DATREK_END_DATREK_BTR_BDR
INTEGERINTEGERINTEGERINTEGERDECIMAL(11,2)
DWL_REK_RSTRST_IDREK_ID
INTEGERINTEGER
DWH_RSTRST_IDRST_NRBNK_NR
INTEGERINTEGERINTEGER
DWS_RST_INARST_IDRST_BEG_DATRST_END_DATRST_ZAK_INDRST_LEN_INDRST_MMD_NCDRST_WTK_NCDRST_NAARST_NAK
INTEGERINTEGERINTEGERSMALLINTSMALLINTSMALLINTSMALLINTVARCHAR(40)VARCHAR(40)
ETL-procedure
Table Table
Table
Table
Table Table
Table Table
Table
Staging
DV DWH
P_Table
Proces
ViewView
ViewView
ViewView
26
Modeling deliverables
� DV DWH
� Create table scripts
� Proces Database
� create P_table scripts
� create view scripts
� create macro scripts
� Sources & Targets in PowerCenter (Metadata Exchange)
27
Modeling procedure
2b SNSDV-repository
Databasescript2a 2c
DWHcreate
ProcesP-tabelcreate
ProcesViewcreate
ProcesMacrocreate
3bSourcesTargets
PowerCenter3a
PDM inrepository
1b PDM1a CDM1a CDM 1b PDM
Databasescript2a 2b SNS
DV-repository2c
DWHcreate
ProcesP-tabelcreate
ProcesViewcreate
ProcesMacrocreate
3a PDM inrepository
28
Advantages
� DWH modeling
� Standardized
� Flexible model
� Very well suited for incremental development
� ETL development
� Less development and test effort
� Database dependancy is isolated
� Performance
� Using capacity Teradata in ETL-proces
29
Further developments
1. Generating PowerCenter workflows/mappings
2. Adding Data Mart functionality
1. Type 1 functionality
2. Type 3 functionality
3. Generating DV DWH model direct from source system specification
30
For more information
� SNS
� Data VaultTM
� www.danlinstedt.com