9 copyright © 2009, oracle. all rights reserved. deploying and reporting on etl jobs

48
9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Upload: barnard-briggs

Post on 21-Jan-2016

219 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

9Copyright © 2009, Oracle. All rights reserved.

Deploying and Reporting on ETL Jobs

Page 2: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 2

Objectives

After completing this lesson, you should be able to do the following:

• Use the Control Center Manager to deploy objects and mappings

• Execute the mappings to load data into tables

• Use the Repository Browser

Page 3: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 3

Lesson Agenda

• Logical versus physical implementation – Locations, Control Centers, Configurations– Deployment concepts

• Control Center Manager– Interface– Deploy preferences

• Execute mappings and view loaded data

• Repository Browser– Start the listener– Start the HTML interface– Reports

Page 4: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 4

Data Warehouse Implementation: Typical Steps

1. Define the source metadata.

2. Define staging area metadata.

3. Define a relational dimensional model.

4. Create process flows.

5. Deploy the mappings.

6. Execute or run the mappings.

7. View the data. Part 1

Part 2

Page 5: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 5

Logical Versus Physical

Logical model(Created metadata at a logical-design level)

Physical implementation(Creates physical database structures)

Page 6: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 6

Physical Implementation

Build and populate warehouse tables.

Validate (optional).

Configure for physicalimplementation.

Generate build andextraction scripts.

Deploy warehouse scripts.

Fix errors.

To database

To files

For laterdeployment

Control CenterManager

Page 7: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 7

Configuring for Physical Implementation

• Specify physical characteristics of generated objects, for example:– Indexes– Tablespace– Partitions

• You can configure, validate, and deploy objects individually in succession or all objects simultaneously.

Page 8: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 8

Setting Object Configuration

Page 9: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 9

Deployment Concepts

• The deployment step creates code from the logical models and stores this code in the Oracle database.

• The code is also audited in the OWB runtime tables, so there is an audit trail for it.

Page 10: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 10

Registering Locations

After you have deployed the objects for a location or explicitly registered the location, you cannot edit or delete it. You can only update its password. You must unregister the location if you want to edit or delete it.

Page 11: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 11

Unregistering Locations

Page 12: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 12

Configurations and Control Centers

• Each configuration maps to a control center.

• Each control center maps to a workspace.

• To work in a particular control center, ensure that the configuration associated with that control center is set to Active.

DEFAULT_CONFIGURATION DEFAULT_CONTROL_CENTER

PROD_CONFIGURATION PROD_CONTROL_CENTER

DEV_WORKSPACE

PROD_WORKSPACE

Active configuration

Default configuration

Page 13: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 13

Active Configuration

Two ways to set a configuration as active configuration:

Option 1

Option 2

Status bar shows the active configuration/control center

Page 14: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 14

Control Center and Locations

• A control center manages many locations.

• A target location can be managed only by a single control center.

• Source locations, by contrast, can be used by multiple control centers.

Control center Locations1

n

Grey means that the locations are registered.

Page 15: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 15

Quiz

At a time, only one configuration can be active.

a. True

b. False

Page 16: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 16

Lesson Agenda

• Logical versus physical implementation – Locations, Control Centers, Configurations– Deployment concepts

• Control Center Manager– Interface– Deploy preferences

• Execute mappings and view loaded data

• Repository Browser– Start the listener– Start the HTML interface– Reports

Page 17: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 17

Invoking the Control Center Manager

Page 18: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 18

Control Center Manager Components

Deployment tree is organized on

locations available in the Control

Center.

Page 19: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 19

Control Center Manager Interface

Hold [Ctrl] to select multiple objects for deployment.

Click Default Actions to change the Deploy Action from None to

Create.

Click Deploy on the toolbar.

1

2

3

Page 20: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 21

Various Deploy Actions

If a mapping's design has changed after deployment, when you click Default

Actions, the Deploy Action changes to Replace

You can select Drop to drop an existing table. You can also upgrade an already

deployed object.

Page 21: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 22

Deploy Options and Preferences

• The default deployment settings allow for the lowest number of user interactions.

• You can customize your deployment environment, that is, the Control Center Manager user interface.– Either use the View menu in Control Center Manager to

enable/disable various prompts.– Or set the Deployment preferences from the Tools menu in

Design Center.

Page 22: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 23

Deployment Preferences

1

2

Page 23: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 25

Control Center Jobs

A job is a deployment or execution submitted to the control center.

You can double-click in the Status column to see the job details.

Generate Run

Completed successfully

Errors

Warnings

Status in the Control Center Jobs panel

Page 24: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 26

Job Details Window

Scroll down here to view the warnings.

If the deployment is successful, you can click the Script tab to

view the generated code.

Page 25: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 27

OWB Automatically Creates a Connector

Connectors are deployed automatically. You do not need to deploy it explicitly.

Connector

Already deployed

Page 26: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 28

Quiz

You can set the following deploy actions for the objects depending on their current deploy status:

a. Upgrade

b. Drop

c. Create

d. Replace

e. Truncate

Page 27: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 29

Lesson Agenda

• Logical versus physical implementation – Locations, Control Centers, Configurations– Deployment concepts

• Control Center Manager– Interface– Deploy preferences

• Execute mappings and view loaded data

• Repository Browser– Start the listener– Start the HTML interface– Reports

Page 28: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 30

Data Warehouse Implementation: Typical Steps

1. Define the source metadata.

2. Define staging area metadata.

3. Define a relational dimensional model.

4. Create process flows.

5. Deploy the mappings.

6. Execute or run the mappings.

7. View the data.

Part 1

Part 2

Page 29: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 31

Executing Mappings

Start

Page 30: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 32

Viewing Data

Page 31: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 33

Practice 9-1 Overview: Deploying, Loading,and Viewing Data

This practice covers the following topics:

• Deploying the target tables and mappings

• Loading the target

• Viewing the data

Page 32: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 34

Lesson Agenda

• Logical versus physical implementation – Locations, Control Centers, Configurations– Deployment concepts

• Control Center Manager– Interface– Deploy preferences

• Execute mappings and view loaded data

• Repository Browser– Start the listener– Start the HTML interface– Reports

Page 33: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 35

Repository Browser

An HTML-based interface to view and generate reports on all repository metadata objects and the relationships between those objects.

Page 34: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 36

Common Repository Browser Tasks

• Identify a recently run mapping or process flow

• Identify the latest deployments

• Identify data objects deployed to a specific location

• Remove old deployment or execution audit details

• Re-execute, abort, or monitor a process run

Page 35: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 37

Starting OWB Browser Listener

• Run ./startOwbbInst.sh located in the [ORACLE_HOME]/owb/bin/unix folder

• Set the oc4jadmin user password

This message indicates you are ready to start the Repository Browser.

Page 36: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 38

Starting the Repository Browser

1. Open a terminal window.

2. Change to the [ORACLE_HOME]/owb/bin/unix folder.

3. Run ./openRAB.sh -b /usr/bin/firefox.

It opens the browser with the login page:

Page 37: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 39

Logging In to the Repository Browser

Page 38: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 40

Browsing Design Center Reports

Click here to open the Reports page

Page 39: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 41

Browsing Design Center Reports

Page 40: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 42

Browsing Control Center Reports

Page 41: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 43

Types of Control Center Reports

Page 42: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 44

Object Summary Report

Click here to view its deployment history.

Page 43: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 45

Deployment Report

Page 44: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 46

Execution Summary Report

Click here to view the execution report.

Page 45: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 47

Execution Report

This is the execution report of a process flow.

Note that all the activities included in the process

flow are listed here. Click the activity to get its

execution details.

Page 46: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 48

Quiz

You have the following two types of reports in the Repository Browser:

a. Design Center

b. Logical reports

c. Control Center

d. Physical Configuration Reports

Page 47: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 49

Summary

In this lesson, you should have learned how to:

• Use the Control Center Manager to deploy objects and mappings

• Execute the mappings to load data into tables

• Use the Repository Browser

Page 48: 9 Copyright © 2009, Oracle. All rights reserved. Deploying and Reporting on ETL Jobs

Copyright © 2009, Oracle. All rights reserved.9 - 50

Practice 9-2 Overview: Viewing Design and Control Center Reports

This practice covers the following topics:

• Administering the warehouse by using the repository browser