the time is now! migrating from owb to odi 12c

The Time is Now!

Stewart Bryson

medium.com/@stewartbryson @stewartbryson linkedin.com/in/stewartbryson

Migrating from Oracle Warehouse Builder to Oracle Data Integrator 12c

Who is Red Pill Analytics?

Red Pill Analytics: Leadership

Stewart Bryson !

Oracle ACE Director !

Previously From: Rittman Mead

Informix Software !

Data Warehousing & Business Intelligence

since 1996

Kevin McGinley !

Oracle ACE Director !

Previously From: Accenture

BI Consulting Group !

Data Warehousing & Business Intelligence

since 1997

About Red Pill Analytics

Other Services

• Expert Retainer • Support • Training

•DevOps for BI and DI •Hosted or On-premise •Used in Capacity Analytics

Capacity Analytics

•Development-as-a-service •Agile methodology • Faster/cheaper than traditional consulting • Subscription billing

Oracle Technology Network White Paper

http://bit.ly/owb-odi

Google Search: otn odi bryson

Oh Captain My Captain

Goodbye Old Friend

Migrations are Hard

Add Value

Have a Mission Statement

Mission Statement

Any task undertaken to migrate content from OWB to ODI will add immediate value to our BI stakeholders.

ODI 12c: Overview

Flow-Based Declarative Design with Component-Based

Development

New Mappings replace interfaces and allow multi-step

design patterns

Reusable Mappings and Datasets for Declarative Design

similar to 11g

ODI 12c: Overview

Components Provide Multi-Step Process

ODI 12c: Overview

Components Provide Multi-Step Process

Data Lineage built into the Mapping Editor

ODI 12c: Overview

Warehouse Builder-like Components including

Pivot/Unpivot, Join, Expression, Set, etc.

ODI 12c: Overview

Component-Style KM’s encapsulate modular, reusable

pieces of logic specific to particular Components

ODI 12c: Overview

Installing ODI 12c: Enterprise Installation

Enterprise Installation includes Fusion Middleware

and supports Standalone Colocated Agents

Handles configuration of the Master and Work repositories and other FMW tables (Work

Tables)

JEE Agents can utilize Weblogic Coherence for high

availability

Warning: FMW Needs to be installed

for JEE Agents

Warning: FMW Needs to be installed

for JEE Agents

Ignore This!The Enterprise

Installation installs WLS and FMW

behind the scenes

Features Specifically Selected

WLS and FMW are installed as an internal

feature

We get all this cool stuff!

Repository Creation Utility

Recent Oracle Database versions, including 11gR2 and 12c, as well as DB2 and SQL

Server

Master Repository contains Topology information, Work

Repository contains development information

Creates Fusion Middleware tables, including Fusion Work

Tables

Agents

ODI Agents execute load processes, including compiled

Load Plans and Scenarios

Somewhat comparable to the OWB Control Center (much, much better)

Deployed as JEE Agents or Standalone Agents

Domain Configuration

Use built-in FMW and WLS functionality to “harden” our

ODI Agents

Our JEE-deployed ODI Agent is comparable to an ETL Server

Utilizing Coherence gives us performance increases in

certain circumstances, fault tolerance, etc.

Templates make it easy to mix and match deployed functionality to

our domain

Service Table Schema (STB) stores relevant

information from our install to

feed the templates

In the end, we have a WLS

Domain complete with Admin Server and

Managed Server

OWB Runtime Integration

Execute OWB processes as standard ODI processes, including Mappings and

Process Flows

Full execution from OWB Control Center captured in standard ODI audit tables

Orchestrate our loads wherever we want: ODI Load Plans or OWB Process Flows

OWB Runtime Integration Topology

Data Server configured with

OWB Workspace Owner

JDBC Configuration to

the OWB Workspace

Configure the Workspace Owner

as the Physical Schema

Setting a Logical Schema to

abstract the Physical Schema and Data Server

OWB Runtime Integration Execution

Use the ODI Package Editor and the new

OdiStartOwbJob tool

We can execute Mappings or

Process Flows

OdiStartOwbJob "-WORKSPACE=OWBREP" "-LOCATION=OWF_MGR" "-OBJECT_NAME=SBATCH/MAIN_LOAD" "-OBJECT_TYPE=PROCESSFLOW"

ODI Scenario for Process Flow

Main Process Flow execution

Sub-Process Flow execution

Mapping Execution

Sub-Process Flow execution

Sub-Process Flow execution Mapping Execution

Full Auditing Results

Migration Utility

Supports 11.2.0.4 of Warehouse Builder with Patch

17830453

Apply Patch 17053768 to Data Integrator if not already

included in release

Command-line utility to perform the OWB to ODI

Migration

Migration Utility: Run Modes

FAST_CHECK Performs a read-only check of the OWB repository and reports back the items than can and cannot be migrated.

DRY_RUN Performs a migration to ODI using the ODI 12c SDK, but does not perform a commit at the end of the process.

RUN (Default) Executes the migration and commits migrated objects to the target ODI 12c repository.

Migration Utility: Configuration

ODI Master Repository Connection Information

ODI Work Repository Information

OWB Workspace Information

Migration Options

OWB Workspace Information

Configuration FileODI and OWB passwords

Migration Results

Migrated Mappings

Migrated Models

Oracle Warehouse Builder (Our Old Friend)

Wildly Successful •Flow-based design •High-performing code (EL-T) •Ships with Database 10g and 11g •PL/SQL Code Generation •Freemium model

Deprecated •Certified (not shipped) with Database 12c • In maintenance mode Limited Integration Capabilities

Oracle Data Integrator 12c

Best of both worlds! •Now with flow-based design •High-performing code (EL-T) •Knowledge Module architecture •Enterprise Manager integration •Fusion Middleware integration

Is there value in changing? • “Our organization has a major investment in OWB” • “Our mappings and process flows just work”

If Only There Was a Way to…

Maintain investment in OWB •Continue to execute legacy code •Only port our code when it presents value to do so

Blaze new trails with ODI 12c •Fantastic new features are dying to be used •The Knowledge Module (KM) architecture pays huge dividends

Deploy a coherent strategy •Shouldn’t feel like two tools

It’s not an easy choice

Phase 1: Run OWB Process Flows in ODI

Phase 2: Orchestrate our OWB Mappings in ODI

Phase 3: Re-implement in ODI When Necessary

the time is now! migrating from owb to odi 12c

red pill analytics20warning

red pill analytics2stewart

red pill analytics22we

red pill analytics7http

red pill analyticswho

red pill analyticshave

red pill analyticsmigrations

red pill analyticsoh

Technology

2017 oregon wine symposium | owb update

owb 11gr2 code template mappings

manage schedules externally with msp/ owb/ smartsheet

oracle warehouse builder (owb) 10g r2

oracle data integration - ad...

oracle® fusion middleware workspace to odi work repository...

cai dat owb

ellucianods9.0 upgrade migrating from owb to odi · pdf...

module owb basics

oracle data integrator for owb developers

big data und datenschutz?! - doag.org (bi) bi... · oracle...

oracle warehouse builder 10g r2 (owb)

owb zu odi migration einfach gemacht - opitz consulting

owb to odi - transfer solutions | oracle partner

why and how migrate informatica to odi | infa to odi...

odi 11g für owb-entwickler

white paper das ende von owb - was nun? · pdf fileseite 3...

owb platform adapter cookbook 177344

migrating from owb 11gr2 (11.2.0.4) to odi 12c (12.1.3) ·...

owb solution selling guide