websphere information integrator - ibm · pdf fileinformation integrator.ppt 2 ... oracle,...

WebSphere Information Integrator

Information Integrator.ppt 2

Enterprise Information is in Isolated Silos CUSTOMER

SERVICE MARKETING CUSTOMERS& PARTNERS LEGAL HR R&DFINANCE SALES &

SUPPORT

Independent Sources and Systems


Complex Enterprise InitiativesCUSTOMER


SUPPORT

Imaging/Document

Mgmt

ReportMgmt

Web Content/Media Asset

Mgmt

Database/CustomSystems

NetworkFile

Systems

Workflow/Business

Process Mgmt

SELF-SERVICE COMPLIANCECALL CENTER CRM / ERP WEBSITES


Middleware Makes it Simple, and BetterCUSTOMER


SUPPORT

Imaging/Document

Mgmt

ReportMgmt

Web Content/Media Asset

Mgmt

Database/CustomSystems

NetworkFile

Systems

Workflow/Business

Process Mgmt

SELF-SERVICE COMPLIANCE WEBSITESCALL CENTER CRM / ERP

WebSphere Information Integrator (WII)



Processes, Applications, ClientsInformationConsumers

Multiple access paradigms

Metadata Management

Federation Publication FindReplication

Data and Content Access, Transformation, Caching

Text Search XQuery Content APISQL Query

Multiple Integration disciplines

Any sourceStructuredSemi-structuredUnstructured

Content storesApplications

Message systems

XML, web services, …

DB2OracleSQL Server …


Integrated Access to Information

Our customer service reps need integrated access to information so they can address customer problems the first time they call. How can IBM help us?

WebSphere Information Integrator enables you to access many data sources, including DB2, MS SQL server, Oracle, files system, XML, web services,…

ODI CIO IBM


WebSphere Information Integrator Makes All Data Readily Available

Data sources

Customer Data

Policies

ClaimsInformation

ClaimsPayment

Query

One interface“one” source

InformationIntegration

services Data users


WebSphere Information Integrator Benefits

Information Integrator

Payments….

Incident files…

For the Customer Service Representative - one request to access all information

For the Developer – a portletwith a single SQL query

For the Administrator – single view of servers, wrappers, nicknames

Claims…

SQL SvrDB2 <custssn> xsd:string,<score> xsd:int,….

<custssn> xsd:string,<score> xsd:int,….

ELEMENT incidents (incident)ELEMENT incidentDate(#PCDATA)….

Claims,…Payments,….

Incident files,…

claimid integer

payment decimal

CLAIMS


DEMO: WebSphere Information Integrator

Federated View of all customer information

XML Wrapper

Claims…

Incident files…

SQL SvrDB2 <custssn> xsd:string,<score> xsd:int,….

<custssn> xsd:string,<score> xsd:int,….

ELEMENT incidents (incident)ELEMENT incidentDate(#PCDATA)….

DB2 ddl SQL-svrddl

DB2 ddl DB2 ddl XSD

Federated view

A single SQL query

Schema mapping

SQL Svr Wrapper

Payments….

Wrappers forIndividual source

Data sources


DB2 UDB InformixOracleSybaseTeradataMS SQL ServerODBC

Red Brick WarehouseClassic Federation (5)

IMS, VSAM, CA-Datacom, CA-IDMS, Adabas

IngresLotus NotesMicrosoft AccessMicrosoft ExcelMySQLPostgreSQLProgressSASSybase SQL AnywhereU2 (UniData/UniVerse)and more…

Web ServicesSAPPeopleSoftSiebelContent Data (4)Additional Non-Relational (4)Life Sciences (6)Legacy Data Access via WS II Classic Federation for z/OS (6)Build custom wrappers

Java and C++ SDK

Non-relational WrappersODBC SourceRelational Source

Sample WebSphere Information Integrator Federation Data Sources and Wrappers

WIICE SourceFileNet (6)IBM (6)Microsoft (2)…


WebSphere Information Integrator Data Federation Technologies

Insert, update, or delete rows from federated relational databases

Dynamic query serviceArbitrary SQL statements to be executed at runtime

Leverages intelligence about optimizing access to the data sourcesProvided by the data source wrapper, databaseAdditional logic through User Defined FunctionsCost based pushdown query optimization

Define data caches over any federated dataMaterialized Query Tables (MQTs) based on an input query workloadCube Views over distributed or remote star schemas

Unicode support at the integration engine


WebSphere Information Integrator (WII)


Multiple access paradigms

Metadata Management



Text Search XQuery Content APISQL Query

Multiple Integration disciplines



Message systems




Choose the Replication that Fits Your NeedSQL-based replication architecture

Warehouses, data consistency, distribution and consolidation Replicate data among mixed relational data sources − committed source changes are staged in relational tables before being replicated

to target systemsFlexibility and efficiency in managing scheduling, transformation, and distribution topologies

Queue (Q) Replication Business continuity, workloaddistribution, and multi-site update Moving transactions between DB2 databases− Committed source changes are written in messages

Low latency and high throughput − Send data across networks in compact messages

Managed conflict detection and resolution


Replication: Capture Stage Apply

SQL Replication1. Captures changes (log or trigger-based) and inserts into a staging table2. Apply process asynchronously pulls the updates to the target systems

Log based

Trigger based

External application

IMS

DB2

Any Source

Staging tables

Control

FederationEngine

DB2

Nicknames

Control CD

CD

CD

SQL Capture

SQLApply

Between heterogeneous databases


Replication: Capture Format Apply

ControlControl

FederationEngine

Log based

DB2 Source

DB2 Target

WebSphere MQApply

Q Capture

Queue (Q) Replication1. Changes captured from the log and placed on a WebSphere message

queue (XML)2. Apply process retrieves the changes and applies them to the target system

(in parallel)

Between DB2 source and target


Q Replication Services and Utilities

Apply reads from queue and apply transactions (in parallel)

Subset data via pub/sub and filters

Transformations options to choose

Conflict detection and resolution

Other utilitiesTable differences and repairs The Alert Monitor and Replication Analyzer




Metadata Management



Text Search XQuery Content APISQL QueryMultiple access

paradigmsMultiple Integration

disciplines



Message systems




Event Publishing

Link data events with business processes Application independent integrationRemoves the extra overhead from the transaction itself Eliminates hand coding typically required to detect data changes

Decouples targets from source data sources

DB2 data event publication capabilitiesFrom DB2 and legacy z/OS data sourcesLeverages leading WebSphere MQ messagingSupports heterogeneous targets and clients

DB2 Publishes data events using XML messagesFlexible data formatWidely used in the industry


Each message represents a database transactionXML format option for publishing Publish to WebSphere MQ queue

Event Publishing from DB2 and Mainframe Sources

Control

Log based

DB2 Source

WebSphere MQ XMLMessages

Capture

Event Publishing from DB2

(Classical) Event Publishing from mainframe sources

XML Messages

CICS

metadatacatalog

WebSphere MQ

Log basedIMS

VSAM

Log basedIDMS

Correlation & Publication

Services

Change Capture Agents


Event Publishing Options for DB2 Format

Only data from committed transactions is published Data is self describing with XML tagsRow based = one row per messageTransaction based = one transaction per message

Row ContentSubset by column, subset by predicateChanged column values only or all column valuesNew data values only or include old values

Easy-to-use wizards to configure event publishing

DB2Source

Q Capture

AnyTarget

End User App

Adminq

Remote queueSendq

Local queue

Local queue

Restartq Local queue

Recvq


Correlation and Publication Services for Mainframe Sources

metadatacatalog

correlation service

WebSphereMQ for z/OS

publication service

Chan

ges

Correlation serviceSorts data by unit-of-work identifiersAt end of unit-of-work − Rollback: – flush all data for this unit-of-work− Commit: – reformat data into relational XML messages

– push data to the publication serviceMetadata catalog holds mapping between IMS and VSAM changes and relational table/column definitions that will be published

Publication serviceManages publication to WebSphere MQ persistent queueInitiates recovery data update with the correlation serviceQueue info is defined in configuration files




Metadata Management



Text Search XQuery Content APISQL QueryMultiple access

paradigmsMultiple Integration

disciplines



Message systems




Finding Information Across the Enterprise

Our Customer Service Representatives spend too much time trying to find the correct forms and policies needed to service customer requests.

WebSphere Information Integrator OmniFind is designed specifically for enterprise search. It’s state-of-the-art relevance engine can quickly categorize, summarize, and find the information you are looking for.

ODI CIO IBM


Enterprise Search

Complexities in enterprise searchingLess content … lower chance for perfect matchingHeterogeneous nature (form and size) affects search precisionLess well linked – fewer link and anchor text cues

IBM enterprise searchingSophisticated relevancy algorithms for corporate content− Delivers the best results with sub-second response

Scales for large collections − 500K+ documents and 1000s of concurrent users

Fits easily into enterprise applications− Java APIs with document level security

Eases administration and maintenance − Easy to install, common configurations, analysis under-the-covers


WebSphere Information Integrator OmniFind EditionPowering intranets, extranets, and public corporate websites

Free-form intelligent text search to enterprise sourcesEven sources with no or limited native text search capabilities

High quality, scalable, and secure (J2EE)Millions of documents and thousands of users

Seamless upgrade from WebSphere Portal searchLeverage existing taxonomies, rules, user experience

OmniFind componentsCrawlers access a wide range of information sourcesA search engine determines document relevancy− State-of-the-art relevancy algorithms for corporate content

An indexer provides high speed linkage − Between key document attributes and the documents


DEMO: OmniFind


Example of WebSphere Information Integrator Partners

Extend reach

Enhance analysis and reporting

Enable applications

Enrich function

Expedite deployment

ANSI


Itergo Federate its Databases with WebSphere Information Integrator

Simplify access to disparate data for inventory management and customer careFederated access over Oracle inventory scan data base and DB2 employee and inventory basic and planning database for integrated view of asset and contact information.Federated access across disparate warehouses and data marts for unified client view

“[WebSphere] Information Integrator is a strategic product for all cases where different database systems needs to be federated.”

Thomas DalewskiSystems Engineer, Itergo

Challenge

SolutionBusiness benefits

Simplify asset management and comparison of target/actual inventoryImprove customer service with up to the minute insurance claim reports

Technology benefitsSaves over 10% of IT employee time in data prep and reportingOne tool to access diverse systems across the companyAvoid extensive changes to existing infrastructure


Don’t Cut Your Customer Information Into Pieces

websphere information integrator - ibm · pdf fileinformation integrator.ppt 2 ... oracle,...

Documents