cm/ecm portfolio review, architecture, & directions · dynamic content workgroup documents ......

CM/ECM Portfolio Review, Architecture, & DirectionsJim ReimerDistinguished EngineerChief Architect, Content Management

Content Management basics

Capture physical media and electronic

documentsCapture computer output instead of

printing

Store, manage, and deliver information digitally rather than physically

Streamline business processes

and communications

Business re-engineering with CM

Busi

ness

impa

ct

business processesbuilt around physical information handling

same business processes,with information handled electronically

simplified business processes,exploiting electronic information handling

cost savings in reduced physical handling

increased competitiveness from refined business processes

Deployment Phases

Dat

a Vo

lum

e/R

ate

bilevel documents

grey/color documents

computer output

audio

video

film

Content Management usage by media type

85 90 95 00 05

Year

e-business solutions leverage all content

Relevant, comprehensive information

Structured Data

Business DataBusiness Data Business ContentBusiness Content

Unstructured Data

e-business content

Operational ContentScanned imagesFacsimilesComputer generated output

Web ContentHTMLDynamic content

Workgroup DocumentsWord processorsSpreadsheetsPresentation graphics

Media Assetsaudiovideo

e-business e-business ContentContent

e-business content usage

E-COMMERCEProduct catalogsTransaction recordsPictures, music, video, books....

ERPEmployee InformationInvoicesJob Applications

SCMPurchase OrdersInvoicesProof of Delivery Forms

CRMSelf-service informationBills, statementse-mails, letters, faxLoan applicationsPhone conversations

EnterpriseEnterpriseResourceResourcePlanningPlanning

SupplySupplyChainChain

ManagementManagement

CollaborationBusiness Intelligence

Knowledge Management

CustomerCustomerRelationshipRelationshipManagementManagement

Back OfficeBack Office

CCUUSSTTOOMMEERRSS

SSUUPPPPLLIIEERRSS

EE--CCOOMMMMEERRCCEE

Business Integration (inter- and intra- enterprise)Business Integration (inter- and intra- enterprise)

IndustryIndustrySolutionsSolutions

BankingBankingandand

FinanceFinanceRetailRetail TelecomTelecomGovernmentGovernmentInsuranceInsurance . . . .

EE--CCOOMMMMEERRCCEE

Elements of e-business Content ManagementDigitized content Applications

Customer Customer ServiceService

Supply Supply ChainChain

e-commercee-commerce

ERPERP

Computer generated output

Incoming paper documents

Facsimiles

Audio & Video

PC documents

Web content

StorageLibrary server Object server

Device support Mgmt. Utilities

Application DevelopmentAPIs Components

Capture Search / AccessIndex

WorkflowCreate Rights Mgmt.

Workflow

IBM Content Manager structure

Library Library ServerServer

Object Object ServerServer



e-business e-business ApplicationApplication

access control

referential integrety

integrated hsm & caching

narrowbandwidth

narrowbandwidth

widebandwidth

data modelling & doc mgmtlarge number of entriesall indicies on disk for searchcomplex data modelsmetadata and full textfine grained access controlscpu intensive

large total data volumelarge size per objectstill and streamed objectsonly recently used on disktransparent migrationobject level hsmi/o intensive

or why don't we just do this with a database ?

Advanced SearchParametric, full-textBooleanFuzzy, phoneticRelevance rankingImage ContentSBCS, DBCS

Rights Mgmt.Access controlWatermarkingEncryption

ScaleCross platformMultiple, distributed object serversHard drives to storage serversComputer generated output supportAuxiliary storage to tape and optical

Industry standardsXML, HTMLTIFF, JPEG, MPEG...Device driver supportPopular tool interfacesScanning support

e-business application enablementThin client or workstation configurationsPopular visual builders / development tool supportJava Beans, ActiveX Componants, Java, C++ APIsFolder management

IBM Content Manager highlights

Mgmt. UtilitiesAdministrative GUICatalog config. & maint.Hierarchical Storage ManagementTivoli Storage ManagerTivoli Ready

Library Library ServerServer




e-business e-business ApplicationApplication

Authoring and Collaboration Application

EIP

Author time Repository

CM and

other sources

WebmasterPublish Controls

Run timeWebsites

Website File System

CM and

other sources

EIP

- page content- JSPs- servlettes- authortime controls

- rich media- documents - page content

- JSPs- servlettes

- rich media- documents

author runtime time

templates

WCM Author time and Run time

Content Management Family Version 8

Content

Federated Ops, Workflow, Mining

MPS & partners

CM e-Client& partners

CM Connector

Other Connectors

Java, Beans, C++, ActiveX

WPS, WCMpartners

CM ODProduction WindowsClient

Digital Media

Web Content

CM OD Connector

Content ManagerOnDemand

Content Manager& Video Charger

ODWek

CMProduction WindowsClient & ODMA

OutputOD e-Client

CM OD Connector

EIP- Information Access

IWPMProduction WindowsClient

ImagePlus

IAFCClient

IAFC

Commonstore SAPDomino, Exchange

Core Core FunctionsFunctions

AccessAccess

EnableEnable

Applications

Federated Operations Server

OO ClassesNon-visual components

Visual Components Java Beans, Java, C++, XML

MQSeriesWFlow

ImagePlus Notes Web

SearchFile

System

DB2Oracle

DataJoiner

CM & Video

Charger

CM On

Demand

DominoDoc

BI Info

Catalog

Filenet, DCTM& other

Text Search

& Mining

Crawlerweb sitesfilesemail

Connectors

Thin & Fat clients

Websphere Application Server

Enterprise Information Portal Version 8

Content Manager VideoCharger Version 8

VideoChargerVideoCharger Shared Shared StreamStream

Type t

ext

Type t

ext

Stre

am A

Stre

am A

Stre

am B

Stre

am B

Play

/Rew

/FF/

Stop

Play

/Rew

/FF/

Stop

Stre

am C

Stre

am C

Type t

ext

Type t

ext

Multicast

Video on DemandReal Time Encodingwith Multicast/store

Enterprise Information Portal Version 8

Content Connect

Connectors

Domino Extended Search

LSX, Domino ServerPages

extended search links

Java, C++, ActiveX, Dynamic Server Pages

CC/DESLink

Thin Clients

Connector Connector Connector

Federated Operations Information Mining

Java, C++, Beans, JSP

Categorization SummarizationCreate Retrieve/

View

DeleteUpdate

Production Clients

Workflow

Parallel Routing

Ad Hoc Routing

Multi-Lingual

Connector...

Clustering Language ID

Content Management Portfolio Highlights

ConvergenceOnDemand family converged with OD V7 (GA 9/01)ODWEK being converged with EIPContent Management server family converged with CM V8 Family direction to converge OnDemand and Content Manager servers

SolutionsEnhanced browser, windows, and ODMA clients with CM V8

extended functionreworked usability and asthetics; improved consistencyimproved performance

Family direction to converge OnDemand and Content Manager clientsEnhanced enabling components (Java/Beans and C++/ActiveX)Greatly increased business partner/solution activity

Siebel Green PasturesSAPExchangeLotus/Domino.....

Content Manager V8 Architectural Overview

SQL

SearchEngines

Library Server Resource Manager

DB2 CAE

CM API

Application Server

(Direct callif local)

HTTP, FTP, Files

Thin Client

DB2 Extender

DB2

Security, RI

Stored Procedures

DB2

Security, RIListener

Filters

HSM Obj's

DB2 CAE

CM API

Windows Client

V8 Key Objectives

Enhanced browser, windows, and ODMA client functionexpose all the function of the servers to the client

Application development toolkit for popular OO languagesC++, Java, Beans

Improved performance and scalabilitypush function down the system stackimproved use a parallelism

Improved architecture for application topology flexibility2 or 3 tier models

Improved object delivery optionsHTTP, FTP; file system

New function for additional applicationsdata modelling extensions, enhanced versioning, advanced workflow

Improved exploitation of companion middlewareWebsphere, MQSWF, Tivoli Storage Manager, OAM

Expanded platform coverageNT, AIX, MVS, Sun

New Features and FunctionsImproved data modelling services (XML Repository)

Hierarchical documents (objects)Improved Flexibility in Item relationships - Linking, References

Representation of Folders, Compound Documents, Shared Parts/Objects, Maps, Graphs

Open coupling to Resource ManagersIndexing of and access to data owned by other applicationsVideoCharger

Improved Retention ManagementEach ItemType can have a retention periodExpiration date calculated when Item is created

Number of days, months, yearsCan be updated by applications Removal performed by custom application or clientExpect to provide automatic removal in the future

Improved Event log / Audit trailWho did what and whenRecorded in 2 tables (one for Items, one for Definitions)Level controlled by SysAdmin

New Features and Functions

Versioning - new versioning services for metadataAccess Control

Enabled at the Item and Part levelSimplification

Less than 50 OO Classes, including SysAdminEnabled by exploiting data model changes

API PerformanceMultiple Items per call -- Create, Delete, Checkout/In, etc.Validation at the API where possibleSingle Library Server round trip per call

Tracing and Error LoggingEntry/Exit, detailed trace, data sent/receivedAll errors (including SQL message) logged CM errors will have at least "name" logged

Improved Transaction ManagementAdministrative Domains

New Features and Functions

WorkflowSerial Work Baskets Advanced document routing via MQSeries WorkflowSimplified graphical builder

Auto-FolderingWhen Item is indexed, automatically add it to a folder

i.e., Claims added to Customer folderImplemented on the server, not the client

ItemID - based on timestamp so continuously increasingReduces fragementation/reorg of ITEMS table

SegmentationAt some size (i.e., 50 million records), automatically create a new set of tablesItemID will contain Segment numberArchitected, but not implemented in first release

VideoChargerMPEG 4 supportFilter architecture

Content Manager Version 8.1

Platform coverage CM and EIP with V8.1NT, AIX, Sun with first releaseOperating with DB2 and WebsphereComing release to include

Oracle support for NT, AIX, SunSupport for DB2 V8.1MVS support for Library Server and Object Server

MVS support for EIP planned for release in 2003Lan Cache and Replication

Will be released with first V8.1 fixpack, before y/e 2002

CM Access Control Model

Item

ItemType,ItemView

Access Control ListUsersPrivileges(Conditions)

Access ControlEvaluation Logic

User General Privileges

Special PrivilegesAdministratorOwner

Configuration Parameters

Efficient run-time checkingSupport of multiple protection models

CM V8 Windows Client

CM V8 Browser Client

ODMA Client

Support for additional server function Versioning (1.1.x) Child components (single level) Multi-value attributes

Autofoldering (server function)

Full text search and index capabilities

VideoCharger - New Features MPEG 4 Server Support

Transparent "Click and Play" client - no installation requiredStandards-based support - audio, video, image, rich mediaProvides support for highly interactive environment

Server Filter ArchitectureIBM Filter technology 'future proofs' server architecturePluggable support for new codecs, new features without having to replace server or impact existing installationAllows customized support for enhancements like encryption, live capture, watermarking, proprietary codecs and formats

Basic Server EnhancementsAutomatic calibrationWarm boot supportEnhanced server to server transfersImproved performance, scaling, and reliability

live video

storedvideo

Clients

IP Network

System Admin Preview

CM and EIP - One Admin Client

CM V8 Sys Admin: Text-search Attributes

CM V8 Sys Admin: Text-search Documents

Advanced Workflow

Begin

Work Basket

Collection Point

Decision Point

Join

End

Sub Process

EIP Workflow BuilderImbeded into CM Administrator

Document Routing Definitions imbeded into CM Administration

Defining a Process

Defining a Node

MetaData Migration GUI

EIP Text Mining Languages supported

*) language identification does not distinguish simplified and traditional Chinese

LanguageIdentification

Summari-zation

Categori-zation

Information Extraction

Clustering

English x x x x xJapanese x x x xFrench x x xGerman x x xSimp.Chinese x *) x xTrad. Chinese x *) x xKorean x x xSpanish x x xItalian x x xPortuguese xDanish xSwedish xNorwegian - Bokmal xNorwegian - Nynorsk xFinnish x

EIP Extended Searching

Lotus Databases/Products Document Mgmt Systems Microsoft Indexes Mail Systems Directories

Relational Databases File System Content Commercial Content World Wide Web

* An information access toolkit is provided that enables you to develop your own custom ES link to a data source.

What Can Be Searched (Cont)

Notes / Domino databases (.nsf vers. 4.5 and higher).Domino.DocDomino R5 Domain IndexFile System content not in compressed formatIBM EIP connected data sourcesIBM SecurewayIBM DB2OracleSybaseMS SQL ServerMS ExchangeMS Index ServerMS Site Server

LDAP directories18 Web Search Engines (preconfigured): Yahoo!, Lycos, Excite, HotBot, Google, Alta Vista, ABCNews.com, AOL.com Search, Business Wire, CNN, Canada.com, EuroSeek, FAST Search, GoTo.com, NBCi, PR Newswire, WebCrawler, Yahoo News Headline SearchIntranet Web Sites using a third party web access toolkitES Link Toolkit for additional sources

CM z-series Family Highlights

Ongoing support for ImagePlus/390 and IAFCIWPM support extended to XP

OnDemand family converged 9/01OD V7.1 and ODWEK on zOSOD V2 index and object data supported without migration, via compatability featureIntent to provide tighter integration of OD V2 legacy data with future OD release

migration utility for index dataaccess support for current OD V2 object data without data migration

CM V8 on zOS in forthcoming releaseLibrary and object server/resource manager on zOSExisting CM index data migrated to CM V8 library serverExisting CM object data assessed without data migrationSupported through CM V8 browser and Windows clientsIntent to provide EIP on zOS

focus on providing support for access to CM family on zOSthis release to permit two tiered zOS to browser topology

CM/zOS V8 Specifics

- Common code base with other platforms- Unique exploitation of zOS companion products - OAM- Conforms with platform

- Install via SMP/E- Monitor via SMF, RMF, SDSF, or 3rd party products - Manage via WLM- Security via SAF (RACF)

- Text Search functions not available until DB2 V8- LDAP exit sample not provided on 390- LUM not supported on 390- Resource Manager

- 390 Web Server (vs WAS)- No object migration from 390 to other resource manager- 50 meg maximum object size vs >2 gig (current OAM restriction)

- Prereqs- OS/390 V2R8 or higher, or zOS V1.1 or higher

- Including USS Tools, OAM, IBM HTTP Server- SecureWay Communication Server - Security Level 1

- DB2/390 V7.1 or later- Exploiting features such as UNICODE, temp tables, UNION, UNION ALL