Reference Data Management for a strong SOA FoundationManagement of Look up Codes using Siperian MDM Hub

2Copyright 2007 - Proprietary and Confidential

Reference Data Management

Siperian MDM Hub supports critical reference data management processes:

1. Reference data creation2. Reference data mapping

from various sources3. Reference data workflow and

collaboration4. Hierarchical reference data

management5. Inbound reference data

resolution6. Outbound reference data

resolution7. Reference data services

Difficultly integrating new and existing systems

Inability to integrate divergent data sources containing inconsistent reference data

Incorrect reporting and analysis

Unresolved, dissimilar reference data induce errors in reporting and analysis

Impedes composite applications development

Composite applications can’t be developed when reference data have different values

Reference Data ChallengesReference Data Challenges Siperian FeaturesSiperian Features

3Copyright 2007 - Proprietary and Confidential

Faster and Cost Effective• Simplifies development• Easy to integrate new

systems• Easy to initiate new

transaction-based business operations

Easily leverage normalized reference data in the hub for

• Reporting and Analytics• Composite Applications• Data Synchronization

Business BenefitsBusiness Benefits

Reference Data Management

4Copyright 2007 - Proprietary and Confidential

Reference Data Problem – multiple values

Source System Code Value Code Description

CRM US UNITED STATES OF AMERICA

ERP 223 USA

POS 138 UNITED STATES

CRM DK DENMARK, KINGDOM OF

ERP 335 DENMARK

POS 7 DANMARK

5Copyright 2007 - Proprietary and Confidential

Solving the Lookup Values Conundrum

Siperian Hub Id Code Values Code Descriptions

1 840 UNITED STATES

2 208 DENMARK

  Siperian XRef IdPrimary Key from Source System

Source System Siperian Hub Id Code Description

  1 US CRM 1 USUNITED STATES OF AMERICA

  2 223 ERP 1 223 USA

  3 138 POS 1 138 UNITED STATES

  4 DK CRM 2 DKDENMARK, KINGDOM OF

  5 335 ERP 2 335 DENMARK

  6 007 POS 2 007 DENMARK

Siperian Canonical Lookup

values

Lookup valuescross-reference

6Copyright 2007 - Proprietary and Confidential

Database & Data Model support

Reference Data (Lookup Code) Data Model

COUNTRY CODE CANONICAL VALUES

Primary KeyCodeShort DescriptionLong DescriptionMore_Details...

COUNTRY CODE LOCALE TRANSLATIONS

Primary KeyLocale CodeLocale DescriptionCountry Code (FKey)More_Details...

COUNTRY CODE MAPPING to

OTHER SOURCES

Primary KeyCountry Code (Fkey)Source System NamePrimary Key from SourceCode Value from SourceShort Description from SourceLong Description from SourceMore Details...

ADDRESS DATA

Primary KeyAddressLineCityStateZip5Zip4Country_Code (FKey)

Independent Lookup tables with cross-

reference and locale specific values can

maintain code values that can be used by the Hub, external apps and

integration services

7Copyright 2007 - Proprietary and Confidential

Types of Reference Data

• Simple Lookups – simple codes and associated attributes at a single record level. Examples are country codes, prefix codes, region codes, etc

• Simple Relationship Lookups – simple relationships that define the nature of the connection between two simple or hierarchical lookups, such as person A works for company B or the sales hierarchy for USA Branch

• Hierarchical Lookups –the context of a hierarchy brings simple relationships between the instances of entities in the same domain. For examples, products can be organized into a product hierarchy

• Complex Rollups – parent-child relationships between instances of entities in two different domains. For example, people could roll up into branches and branches can be rolled up into regions and regions then rolled up into operating companies

8Copyright 2007 - Proprietary and Confidential

Hierarchical Reference Data

10Copyright 2007 - Proprietary and Confidential

Reference Data Management Application

11Copyright 2007 - Proprietary and Confidential

Different Uses of Reference Data

Siperian Hub and Reference Data (Lookup Code) Management

Sipe

rian

Hub

and

SIF

SOA

Data

Standardization

Source System 1

Database

Source System 2

Database

Source System n

Database

...Database

Source System 3

Database

Source System n

...

Downstream messages

with relevant Lookup Codes

EAI/ESB

Message Structure

Transformation

EAI/ESB

Message Structure

TransformationUsed for DataOrchestrations

Database

Source System 2

... Cleanse_Put

SOA

Maintenance

Services

Inserts/Updates

Events

Siperian Hub

Database

Source System 1

Batch

ETL

SOA

Lookup Code Translation

Services

Data Mart

Data MartFile

Extracts

ETL

Data MartData MartData Mart

Data WarehouseData

WarehouseData Warehouse

Lookup Codes as Dimensional data

for Reporting systems

Reference Data Management GUI

Code Creation

Code Mapping

Message Structure Transformation – SOA accepts structures and maps to and from Hub to external systems. This work is best done by EAI, ESB and ETL toolsCode sets or Value Translations – SOA service handles translation of codes between canonical and system specific values both for in and out servicesKeys – Hub provides rowid or pkeys as needed by SOA service

1) Lookup data resolution for Batch processes

6) Lookup data resolution for Real-time downstream messaging

2) Lookup data resolution for Real-Time processes

4) Lookup data services for Custom UIs or Composite Apps

3) Consolidated Lookup data for Reporting

5) Lookup data services for Orchestration processes

12Copyright 2007 - Proprietary and Confidential

Reference Data as SOA Foundation

Siperian Hub and Reference Data (Lookup Code) Usage Scenarios

Sipe

rian

Hub

and

SIF

Siperian Hub

Message Structure Transformation – SOA accepts structures and maps to and from Hub to external systems. This work is best done by EAI, ESB and ETL toolsCode sets or Value Translations – SOA service handles translation of codes between canonical and system specific values both for in and out servicesKeys – Hub provides rowid or pkeys as needed by SOA service

...

Reference

Composite Application

EAI/ESB

Message Structure

Transformation

EAI/ESB

Message Structure

Transformation

SOA

CodeSet or

Value Translation

Insert &

Updates

Database

System 1

SOA

CodeSet or

Value Translation

Database

System N

Database

System 2

Distribution

SOA

CodeSet or

Value Translation

Backup

14Copyright 2007 - Proprietary and Confidential

Services Integration Framework – Access and Protocols Overview

SIF SIF Server

XML to JavaAsyncHandler

XML/Soap/JMS

SiperianClient Proxy

Manages protocol usage – like MrmClient.

Req/Resp objects used directly w/ Bean/EJB, or

converted to XML using Castor.

Request Router

Request Processing

Modules

EJB

SOAP

Bean/EJB

XML/Soap

Axis converts between XML and Beans

XML ó Java

Requests and Responses are Java beans – translated at outer layers

HTTPXML/HTTP

JMS

Client Proxy

Synchronous Processing

Asynchronous Processing

Access Protocols

External Apps

Schema specific &

Generic APIs