odi st partnership
DESCRIPTION
TRANSCRIPT
<Insert Picture Here>
Oracle Data Integration An Overview with Emphasis in DW Appliances
Where Does Data Integration Fit?Essential Ingredient for Information Agility
SOA• Data Services• Information
services• Process
Integration• Event driven
data integration• Governance
and Impact Analysis
Business Intelligence
• Data Integration for BI applications
• Event driven BI• Heterogeneous Data
Access• Information-based
analytics• Report to Source
Data LineageEnterprise DataWarehousing
• Extract, Transform, Load• Data Migration, Bulk Data• Data Quality, Profiling
Master Data Management
Data Integration
Oracle Data WarehouseBreaks Data Bandwidth Bottlenecks
• More Pipes• Modular storage “cell” building blocks
organized into Massively Parallel Grid • Bandwidth scales with capacity
• Bigger Pipes• InfiniBand interconnect transfers data 5x
faster than Fibre Channel
• Ships Less Data Through Pipes• Query processing is moved into storage
to dramatically reduce data sent to servers while offloading server CPUs
• Runs the Oracle Database• Database and options run unchanged Exadata Moves a Lot
Less Data a Lot Faster
Oracle Master Data ManagementComprehensive MDM Application Solutions
Data Governance
Oracle Fusion Middleware
Analytical MDM AppsAnalytical MDM Apps
Operational MDM AppsOperational MDM AppsC
usto
mer
Cus
tom
er
Sup
plie
rS
uppl
ier
Pro
duc
tP
rod
uct
Application Integration Architecture
Enterprise schema & Common services
Enterprise schema & Common services
Inst
all
Bas
eIn
sta
ll B
ase
Em
ploy
eeE
mpl
oyee
Fin
anci
alF
inan
cial
Oracle / Hyperion Data Relationship
Management
Oracle / Hyperion Data Relationship
Management
Ana
lytic
alA
naly
tical
Site
Site
OperationalSystems
EBSEBS
SiebelSiebel
SAPSAP
Custom AppsCustom Apps
External Apps
External Apps
PeopleSoftPeopleSoft
JDEJDE
BudgetingBudgeting
AnalyticalSystems
DWDW
BI &DatamartsBI &Datamarts
PlanningPlanning
DashboardsDashboards
Financial Consolidation
Financial Consolidation
Use Cases for Oracle Data IntegrationUnified Data Integration Platform for Enterprise Projects
Data Integration• Bulk-load historical data to new application
• Synchronize new and old applications
• Complex transformations, CDC
• Ensure database-level consistency across applications bidirectional
BI & Data Warehouse• Real-time Data Warehouse for BI
• Populate Warehouse with High Performance ODI
• Aggregates and aligns data for operational analytics, performance management, etc
Modernization• Mainframe / iSeries sources to Oracle RAC
• Re-architect legacy batch processing to SOA and ODI-EE
• Unification of structured and unstructured data
Data Migrations & Consolidation• Upgrade Applications or Migrate to New Schema
• Single-time Bulk load and/or keep in Sync with ongoing translation, delivery of data.
• Applications merge support
SOA Initiatives• Establish Messaging Architecture for Integration
• Incorporate Efficient Bulk Data Processing with ODI
• Providing data access, transformation etc. as services within SOA
Master Data Management• Create Single View of the Truth in real time
• Aggregating multiple operational sources
• Synchronize Data with ODI-EE
• Supports master data stores, publishes master data changes to all consumers
Introducing ODI-EE
Key Data Integration Products
• Comprehensive Integration• ELT/ETL for Bulk Data• Data Delivery Services• Process Orchestration• Service Bus
• Human Workflow• Data Federation• Replication & Migration• Data Governance• Data Grid
• ELT/ETL for any DB• Changed Data Capture• Native SQL Code Gen• Declarative Design
• ELT for Oracle DB• Database Modeling• PL/SQL Code Gen• Flow-based Design
• Business Data / Metadata• Statistical Analysis
• Time Series Reporting• Integrated Data Quality
• Cleansing & Parsing• De-duplication
• High Performance• Integrated w/ODI
New
Oracle Core FeaturesComprehensive Data Integration Platform
• E-LT Data Processing• Set-based Transformation• Configurable Deployment (E-LT, E-T-L, or others)• Native Code Generation
• Declarative Integration Designer• Reverse Engineering of Sources• Intuitive Data Mapping• Built-in Reporting
• Metadata Lineage• Graphical Impact Analysis
• Native SOA Interoperability• SOA Sources, Targets, or Invoke-able E-LT Jobs, SOA Workflow, etc.
• Automatic Error Handling with Data Recycling• Changed Data Capture
• Built-in Support for Realtime Data Capture and Streaming • Log-based or Trigger-based
• Inline Data Quality• Extensible Knowledge Module Framework
Data Integration Core Use CaseComprehensive, Lightweight Data Integration
• Key Architecture Benefits: 100% Java, Open APIs, very fast E-LT• Embeddable Java Agent consumes very little CPU or RAM• E-LT Architecture uses DBMS CPUs, not the Application CPUs• Open APIs, Open Metadata, Open XML Knowledge Modules
DDAA
BB
File C
File C
C$_0C$_0
C$_1C$_1
LKMLKM
LKMLKM
IKMIKM
I$I$ E$ (Errors)E$ (Errors)
CKMCKMIKMIKM
RKMRKM
JKMJKM
Check-Load Check-Load Transform TransformExtract-LoadExtract-Load
ODI Agent
ERPApplication
Business Intelligence& Data Warehouse
ODI Agent may be deployed in any part of the architecture
ODI Agent may be deployed in any part of the architecture
Move and transform data. Mixed sources and targets.
BENEFITS KEY DIFFERENTIATED FEATURES
1. Performance >>> Heterogeneous “E-LT”
2. Flexibility >>> Event-Driven Platform
3. Productivity >>> Declarative Design
4. Open >>> 100% Java and SOA Native
5. Hot-Pluggable >>> Knowledge Modules
ODI-EE Value PropositionAgile Data Integration
11
1212
Differentiator: E-LT ArchitectureHigh Performance
Conventional ETL ArchitectureConventional ETL Architecture
Extract LoadTransform
Next Generation ArchitectureNext Generation Architecture
“E-LT”“E-LT”LoadExtract
Transform Transform
Conventional: Separate ETL Server• Proprietary ETL Engine• Poor Performance• High Costs for Separate Standalone Server• IBM & Informatica’s approach
Oracle: No New Servers• Lower Cost: Leverage Compute Resources &
Partition Workload efficiently• Efficient: Exploits Database Optimizer• Fast: Exploits Native Bulk Load & Other
Database Interfaces• Scalable: Scales as you add Processors to
Source or Target
Benefits• Optimal Performance & Scalability• Better Hardware Leverage• Easier to Manage & Lower Cost
Real Time Data WarehouseReal Time Data WarehouseReal Time Data WarehouseReal Time Data Warehouse
Logs
Logs
Logs
CDCRecords
CDCRecords
CDCRecords
CDCRecords
CDCRecords
CDCRecords
CDCRecords
CDCRecords
CDCRecords
Transactional
RDBMS
Transactional
RDBMS
Transactional
RDBMS
Source Systems Data WarehouseSource DB’s Redo Logs /
TriggersChange Tables
SubscriptionViews
Staging Area
Data Warehouse
Differentiator: Changed Data CaptureEvent-Driven Framework for Realtime Data Warehouse
14
Focus on Oracle BIEE Suite PlusUnify Data Integration with Business Intelligence
• Integrated with Oracle BIEE Plus
• Support for relational, R-OLAP, OLAP sources & targets
• Report-to-source lineage• Drill-in from a Report • Get query, DW schema, source
tables, transforms• Gain confidence in analytics
• Unified infrastructure• Unified metadata & lineage • Integrated Data Quality• Unified data access, • Common administration &
monitoring• Integrated scheduling & security • Common auditing & tracing• Common error handling
Oracle BIEE Suite PlusOracle BIEE Suite Plus
Oracle EBS
Oracle EBS
PeopleSoftPeopleSoft
SAP/R3SAP/R3
Other Sources
Other Sources
Data Warehouse
Data Warehouse
CDC
MessageQueues
MessageQueues
Enterprise Data Warehouse
Enterprise Data Warehouse
Design & Drill
Data Flow
Bulk and Real-Time Data Processing
Oracle Data Integration SuiteOracle Data Integration Suite
Metadata Lineage
Data Distribution & Delivery APIs
Bulk/Trickle Loading
Changed DataCapture
MasterData
Data Quality& Profiling
ODI Knowledge Module Framework
Information Assets
Oracle Business Intelligence Server
Common Enterprise Information Model
InteractiveDashboards
Ad hocAnalysis
ProactiveAlerts
MicrosoftOffice
Reporting
& Publishing
• Oracle RAC• Teradata• Netezza…etc
Report to Source Data LineageExplore Lineage from Target Columns to Source Columns
Focus on OBI Analytic Applications Overview
• Pre-Built BI Analytic Applications• Pre-built Metrics, 5000+ Dashboards, Data
Warehouse 350+ Star Schema• Implementation Time: 3-4 Weeks• Works with EBS, PSFT, SAP, SEBL, JD-
Edwards Sources• Biggest Savings: Pre-built ETL
• Faster & Lower Cost to Build & Maintain ETLs
• Knowledge Module Architecture Enables Efficient Development of Packaged ETL
• Reduce Complexity and Size of Code• Reuse DW Creation, Update, Load Times• Value-add Modules (e.g. SOX)
• Extensible by Customers & System Integrators
Oracle BI Analytic ApplicationsOracle BI Analytic Applications
Oracle BI Server and Semantic Layer
Oracle EBS
People Soft
SAP/R3Other
Sources
Data Warehouse
CDCMessage Queues
Analytics Data Warehouse
Information Assets
Sales MKtingOrder Mgt
Supply Chain
FinanceHRContact Center
Data Flow
Bulk and Real-Time Data Processing
Oracle Data IntegratorOracle Data Integrator
Metadata Repository
ODI Knowledge ODI Knowledge Modules for BI Modules for BI
Analytic Analytic ApplicationsApplications
Bulk Transform.
Changed Data
Capture
Data Integrity
Data Quality
ODI Connectivity Framework
Pre-Built ODI Interfaces and Pre-Built ODI Interfaces and Transformation Packages for Transformation Packages for
Analytic ApplicationsAnalytic Applications
Weeks or monthsWeeks or months
Pre-built BI AppsPre-built BI Apps
ETL ETL MappingMapping
DW DesignDW Design
TrainingTraining
Years or quartersYears or quarters
Metrics & Metrics & DashbrdsDashbrds
Build from ScratchBuild from Scratch
50%50%
Oracle Hyperion Oracle Hyperion PlanningPlanning
Oracle Hyperion Oracle Hyperion Financial MgtFinancial Mgt
Oracle Hyperion Oracle Hyperion EssbaseEssbase
Planning API HFM API Essbase API
Oracle | Hyperion Data AccessOracle | Hyperion Data Access
Data ServicesAuthentication Logging Services
API Layer
Hyperion Hyperion PlanningPlanning
Hyperion Hyperion Financial Financial
ManagementManagement
Hyperion Hyperion EssbaseEssbase
Metadata Discovery & Model Creation
Extract DataUse
Essbase KM Extracts Dimension Members
UseEssbase KM
Loads Data Loads Dimension Members
Other Features Cube Refresh Consolidate Calculate
Oracle Hyperion Application Adapters
Focus on Oracle | Hyperion ApplicationsLeveraging EPM with Embedded Data Integration
Oracle Data Integration SuiteOracle Data Integration Suite
Metadata Lineage
Data Distribution & Delivery APIs
Bulk/Trickle Loading
Changed DataCapture
MasterData
Data Quality& Profiling
ODI Knowledge Module Framework
Oracle EBS
Oracle EBS
PeopleSoftPeopleSoft
SAP/R3SAP/R3
Other Sources
Other Sources
Data Warehouse
Data Warehouse
CDC
MessageQueues
MessageQueues
Information Assets
Bulk and Real-Time Data Processing
Focus on Hyperion MDMFoundation for Data Relationship Management (DRM)
• Hierarchy management• Derivation/inheritance• Classification, categorization• Attribute management
• Change management• Streamlined, automated• Valid-from, Valid-to ranges• Compare any 2 versions
• Business-user driven• Easy user declarative tool• Specify business rules • Multi-user collaboration• What-if & historical analysis
• Meets IT requirements• Synchronize with operational systems• Complete auditing, fine-grained
security• Configurable, no coding
Hyperion Data Hyperion Data Relationship Relationship ManagementManagement
Oracle EBS
People Soft
SAP/R3Other
Sources
Data Warehouse
CDCMessage Queues
Oracle Data IntegratorOracle Data Integrator
DRM Import/Export
Profiles
Bulk and Real-Time Data Processing
Metadata Repository
ODI Knowledge Modules for DRMODI Knowledge Modules for DRM
Bulk Transform.
Changed Data
Capture
Data Integrity
Data Quality
ODI Connectivity Framework
Information Assets
18
Oracle Oracle Data Data
IntegratorIntegrator &&
Oracle Oracle Data Data
QualityQuality
Oracle Oracle Data Data
IntegratorIntegrator &&
Oracle Oracle Data Data
QualityQuality
Hyperion Data Relationship ManagementClosed-loop Master Data Management
OperationalOperational
E-Business SuiteE-Business Suite
JD EdwardsJD Edwards
HRHR
LegacyLegacy
SAPSAP
Siebel CRMSiebel CRM
People SoftPeople Soft
Hyperion Data Relationship ManagementHyperion Data Relationship Management
Hierarchy Governance
Master Hierarchies and Versions
Cost Centers
Entities Accounts Org Struct Geography
AnalyticAnalytic
Financial AppsFinancial Apps
BudgetingBudgeting
Planning & Planning & ForecastingForecasting
AnalyticsAnalytics
Key PerformanceKey Performance
Query / ReportingQuery / Reporting
Enterprise Enterprise ReportingReporting
19
ODI-EE A Look Ahead
ODI for Oracle FusionData Integration as a Key Fusion Differentiator
• Fusion Applications
• Built-in, Automated Data Replication among ERP Applications
• Fusion Business Intelligence
• Pre-built Analytics from Fusion ERP Applications
• Automatic Mapping and Model Updates (Application-driven)
• Fusion Master Data Management
• Data Replication, Conflict Detection and Conflict Resolution
• Fusion w/Essbase
• Fusion Financials (Automatic Financial Consolidation)
• Pre-built Essbase Content with Apps and Business Intelligence
2009 2010
2011
UnifiedTeam
UnifiedPlatform
High-Level Data Integration RoadmapTowards a Unified ETL Platform
• OWB/ODI Investments are Fully Protected
• No Forced Migrations• Natural Upgrade Path• Unified Platform aims to be
a Superset of Existing Products – no regression
2009
ODI J2EE Deployment ArchitectureLogical Architecture Overview
JDeveloper
ODI in JDev
Designer Operator
Security Topology
WLS
Data Sources Connection Pool
Repository Data Sources Sources Data Sources Target Data SourcesRepository Data Sources Sources Data Sources Target Data Sources
Repository Data Sources Sources Data Sources Target Data Sources
Servlet Container
ODI Agent
ODI Thin Client
Web Service Container
ODI Transform. Service
ODI Data Services
Any Application Container
Any Application
ODI SDK APIs
MBeans Server Registry
Any MBeans App
ODI MBeans for ODI Agent
Sources and Targets
ERP
---------
---
------
CRM
- - -
Legacy
---------
---
------ ---
---------
------
Best-of-Breed ApplicationsPLM
RDBMS – ODI Repositories
ODI Master Repository
ODI Work RepositoryODI Work
RepositoryODI Work
Repository
Any Java App
Any Java App
Any Application
ODI SDK APIs
Any Web App
ODI 11gR1 New FeaturesAvailability Planned for 1HCY10 Timeframe
• JDeveloper-based Tooling• J2EE deployment option (using Weblogic Server)• Standalone Option is Preserved – using Jetty• JPS-based Security (external password management)• Enterprise Scheduler (ESS) Integration• Enterprise Manager Integration• New Thin Client (consolidated + more mgmt features)• Set-based Operators and Temporary Index Management• Java SDK APIs for Improved Embedability• JDE Enterprise One Knowledge Modules (v8.x and higher)• SAP ERP Knowledge Modules (v4.6 and ECC 6.0)• SAP iDocs Knowledge Modules (v4.6 and ECC 6.0)• SAP BW Knowledge Modules (v3.5 and v7.0)
24
Customer Examples
Enterprise Data WarehouseRaiffeisen Bank
• Meets legal requirements for data consolidation in the head office (Basel II, Investor reporting)
• Seamless and realtime Capital Market reporting to investors and stakeholders• Single-source of truth for business information – supports Business Intelligence and EDW• One standardized enterprise data model over the whole RZB Group• Reduction of core integration/development costs through central development practice• Reduced time to market for new Group applications through central interface development
• Performance Issues with existing ETL Tool (IBM DataStage)
• New functions required for the next DWH releases (realtime, replication, etc)
Business Challenges
Oracle Data Integration Solution Benefits
IT Challenges
• Costs for Enterprise Data Warehouse infrastructure were growing too fast
• EDW processes not keeping up with 24x7 operations, ETL batches too slow
Order Replenishment, Online CatalogJ. Crew
• Simplified the end-to-end data integration with all their core IT systems and database platforms to reduce the total cost of ownership of their order replenishment and cataloging
• Benefited from the Oracle advantage in batch processing, bulk data transformation for increased performance
• Successfully leveraged SAP and Teradata integration to phase out legacy systems and ultimately reduce costs
• Order replenishment for online catalog system • Define new corporate standard for data integration• Better integrate data across 175 retail stores and 52
outlet chains
Business Challenges
Oracle Data Integration Solution Benefits
IT Challenges
• Replace antiquated home-grown solution of scripts• Teradata bulk data support, and help integrate data
across SAP, Red Prairie Inventory systems
Financial Services, ReinsuranceNew Reinsurance, Division of the Munich Re Group
• Seamlessly integrated across (Oracle applications (E-business Suite, Siebel CRM) SAP, IBM, etc) to manage the regeneration of all code, scripts, and metadata across the different environments.
• Lowered the cost of development by taking advantage of ODI’s declarative model, ease of use, and team collaboration capabilities.
• NRC benefited from the flexibility and standards based approach of ODI, helped leverage the existing environment.
• Needed quality of data but uncompromising on the cost to meet that objective.
• Data interactions between multiple complex systems, including both SAP and homegrown insurance applications
Business Challenges
Oracle Data Integration Solution Benefits
IT Challenges• Hard to modify and maintain manually-developed
data transfer programs. • Data transfers as part of reinsurance, risk
transactions
Improve Inventory ControlRoss
• Seamless data integration from heterogeneous sources leveraging SOA helped to create a more flexible, standards based integration approach
• 73% Bulk data transfer performance improvement• Together with Oracle SOA Suite (Oracle BPEL PM) provided business optimization, process visibility,
exception handling• Closed loop processing using BAM and Data Integration combined eliminated ordering/replenishing
inventory errors by reducing inaccurate data
• Hard to consolidate consistent, accurate inventory information across over 800 multiple store chains
• Lack of visibility to errors to the business• Higher cost and time to delivery of new value
Business Challenges
Oracle Data Integration Solution Benefits
IT Challenges• Current state was complex, didn’t scale, and difficult
to manage• Non-standard approach required coding paradigm,
inconsistent error handling
Dain HansenDain Hansen
Shared Data ServicesVerizon
• ODI + SOA helped to build out a shared services layer which helped provide greater flexibility• These shared services consolidate database (DB2, Sybase, Informix to Oracle), consolidate ERP
(PeopleSoft HR/Payroll, Decommissioning SAP), consolidate middleware (Oracle FMW) and consolidate BI/ETL
• In addition the program helped to decommission Cystal and Cognos and adopt Oracle BIEE
• Streamline and automate business processes around new hire on boarding
• Provide better business insight and manage FiOS supply chain
Business Challenges
Oracle Data Integration Solution Benefits
IT Challenges• Lower the cost of rewriting SAP, PSFT & Legacy
interfaces (about 209) through custom code• Lower the cost of IT infrastructure from multiple
systems
Dain HansenDain Hansen
Sales and Marketing Data Warehouse Nestle
• Replaced weekly insertion with daily recording of change in status with time imprint for all clients—allowing for more effective client follow-up, for example
• Improved response times by transferring reporting processes to the data warehouse• Improved reactivity for restocking requirements thanks to daily updates on stock quantity and value for each store• Provided overall view of the status of business processes, resulting in improved user communication
• Hard to consolidate consistent, accurate inventory information across over 800 multiple store chains
• Lack of visibility to errors to the business• Higher cost and time to delivery of new value
Business Challenges
Oracle Data Integration Solution Benefits
IT Challenges• Manage a data warehouse for operational
transactions and marketing information• Scale available for high-value-added actionable
data on clients, orders, stock, etc.
Dain HansenDain Hansen
• Enable the marketing and CRM team to better target its campaigns and activities across 50 countries
• Anticipate future reporting challenges, in light of the strong increase in the volume of production data
Questions
The preceding is intended to outline our general product direction. It is intended for information
purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any
material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any
features or functionality described for Oracle’s products remains at the sole discretion of Oracle.