copy 2010 Quest Software Inc ALL RIGHTS RESERVED

Integrating Workload Replay into Database Change Management

Bert ScalzoDatabase Domain Expert Oracle ACEwwwtoadworldcomBert

wwwBertScalzocom

2

Authorrsquos Books Coming Soon

3

Purpose

bull Learn how one can rely on Benchmark Factory and actual captured database workload replay to more reliably ensure that normal database changes donrsquot degrade the user experience

bull Might save your reputation sanity and job

bull Note Not Oracle specific but examples here shown using BMF and Oracle trace file replay

4

Agendabull Common challenges when dealing with

database changebull Benefits of using database workload replay in

change management methodologybull Performing database workload replay with

Benchmark Factory

The preceding is intended to outline our general product direction It is intended for

information purposes only and may not be incorporated into any contract It is not a

commitment to deliver any material code or functionality and should not be relied upon

in making purchasing decisions The development release and timing of any features or

functionality described for Quest Softwarersquos products remain at the sole discretion of

Quest Software

5

Database Changebull All applications amp databases change over timebull Often changes are small amp thus seemingly safebull Sometimes changes are significant amp very riskybull All change introduces risk ndash no matter the sizebull In fact studies have shown that the most ldquobuggyrdquo changes to

code occur when less than 5 lines are modified (ie quick fixes are not very successful)

bull Database changes work much the same when you try ldquoquick and simplerdquo modifications without much thought bad things generally happen hellip

6

The Many Sources of Change

bull Hardware upgrades virtual resource re-allocation or virtual machine relocationbull Software upgrades (eg new operating system or update to virtual machine

software)bull Operating system andor virtual machine setup configuration andor initialization

parametersbull Database patches andor upgrades (eg 10203-gt10204 or Oracle 10gR2-

gt11gR2)bull Database setup configuration andor initialization parameters (eg SGAPGA

memory allocations)bull Database structural changes (eg adddropalter tables columns indexes and

views)bull Storage nature changes (eg start using partitions sub-partitions index organized

tables etc)bull New database feature usage (eg start using 11G optional OEM ldquoauto plan stabilityrdquo

features)bull Statistics andor histogram collection frequency granularity parameters andor

method (SQL command vs PLSQL package call)bull Relative size of the database (eg most databases grow over time ndash some grow

exponentially)

7

Managing Change

bull Measure of successndash Effective Results AFTER = BEFOREndash Efficient Performance AFTER ~= BEFORE

bull How to measure effectivenessndash Unit testingndash Integration testing

bull How to measure efficiencyndash Stress Testing (too often a simple hardware stress

scenario to prove that system can handle a ldquoloadrdquo)ndash Workload replay only way to assure real success

hellip

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

3

Purpose

bull Learn how one can rely on Benchmark Factory and actual captured database workload replay to more reliably ensure that normal database changes donrsquot degrade the user experience

bull Might save your reputation sanity and job

bull Note Not Oracle specific but examples here shown using BMF and Oracle trace file replay

4

Agendabull Common challenges when dealing with

database changebull Benefits of using database workload replay in

change management methodologybull Performing database workload replay with

Benchmark Factory

The preceding is intended to outline our general product direction It is intended for

information purposes only and may not be incorporated into any contract It is not a

commitment to deliver any material code or functionality and should not be relied upon

in making purchasing decisions The development release and timing of any features or

functionality described for Quest Softwarersquos products remain at the sole discretion of

Quest Software

5

Database Changebull All applications amp databases change over timebull Often changes are small amp thus seemingly safebull Sometimes changes are significant amp very riskybull All change introduces risk ndash no matter the sizebull In fact studies have shown that the most ldquobuggyrdquo changes to

code occur when less than 5 lines are modified (ie quick fixes are not very successful)

bull Database changes work much the same when you try ldquoquick and simplerdquo modifications without much thought bad things generally happen hellip

6

The Many Sources of Change

bull Hardware upgrades virtual resource re-allocation or virtual machine relocationbull Software upgrades (eg new operating system or update to virtual machine

software)bull Operating system andor virtual machine setup configuration andor initialization

parametersbull Database patches andor upgrades (eg 10203-gt10204 or Oracle 10gR2-

gt11gR2)bull Database setup configuration andor initialization parameters (eg SGAPGA

memory allocations)bull Database structural changes (eg adddropalter tables columns indexes and

views)bull Storage nature changes (eg start using partitions sub-partitions index organized

tables etc)bull New database feature usage (eg start using 11G optional OEM ldquoauto plan stabilityrdquo

features)bull Statistics andor histogram collection frequency granularity parameters andor

method (SQL command vs PLSQL package call)bull Relative size of the database (eg most databases grow over time ndash some grow

exponentially)

7

Managing Change

bull Measure of successndash Effective Results AFTER = BEFOREndash Efficient Performance AFTER ~= BEFORE

bull How to measure effectivenessndash Unit testingndash Integration testing

bull How to measure efficiencyndash Stress Testing (too often a simple hardware stress

scenario to prove that system can handle a ldquoloadrdquo)ndash Workload replay only way to assure real success

hellip

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

4

Agendabull Common challenges when dealing with

database changebull Benefits of using database workload replay in

change management methodologybull Performing database workload replay with

Benchmark Factory

The preceding is intended to outline our general product direction It is intended for

information purposes only and may not be incorporated into any contract It is not a

commitment to deliver any material code or functionality and should not be relied upon

in making purchasing decisions The development release and timing of any features or

functionality described for Quest Softwarersquos products remain at the sole discretion of

Quest Software

5

Database Changebull All applications amp databases change over timebull Often changes are small amp thus seemingly safebull Sometimes changes are significant amp very riskybull All change introduces risk ndash no matter the sizebull In fact studies have shown that the most ldquobuggyrdquo changes to

code occur when less than 5 lines are modified (ie quick fixes are not very successful)

bull Database changes work much the same when you try ldquoquick and simplerdquo modifications without much thought bad things generally happen hellip

6

The Many Sources of Change

bull Hardware upgrades virtual resource re-allocation or virtual machine relocationbull Software upgrades (eg new operating system or update to virtual machine

software)bull Operating system andor virtual machine setup configuration andor initialization

parametersbull Database patches andor upgrades (eg 10203-gt10204 or Oracle 10gR2-

gt11gR2)bull Database setup configuration andor initialization parameters (eg SGAPGA

memory allocations)bull Database structural changes (eg adddropalter tables columns indexes and

views)bull Storage nature changes (eg start using partitions sub-partitions index organized

tables etc)bull New database feature usage (eg start using 11G optional OEM ldquoauto plan stabilityrdquo

features)bull Statistics andor histogram collection frequency granularity parameters andor

method (SQL command vs PLSQL package call)bull Relative size of the database (eg most databases grow over time ndash some grow

exponentially)

7

Managing Change

bull Measure of successndash Effective Results AFTER = BEFOREndash Efficient Performance AFTER ~= BEFORE

bull How to measure effectivenessndash Unit testingndash Integration testing

bull How to measure efficiencyndash Stress Testing (too often a simple hardware stress

scenario to prove that system can handle a ldquoloadrdquo)ndash Workload replay only way to assure real success

hellip

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

5

Database Changebull All applications amp databases change over timebull Often changes are small amp thus seemingly safebull Sometimes changes are significant amp very riskybull All change introduces risk ndash no matter the sizebull In fact studies have shown that the most ldquobuggyrdquo changes to

code occur when less than 5 lines are modified (ie quick fixes are not very successful)

bull Database changes work much the same when you try ldquoquick and simplerdquo modifications without much thought bad things generally happen hellip

6

The Many Sources of Change

bull Hardware upgrades virtual resource re-allocation or virtual machine relocationbull Software upgrades (eg new operating system or update to virtual machine

software)bull Operating system andor virtual machine setup configuration andor initialization

parametersbull Database patches andor upgrades (eg 10203-gt10204 or Oracle 10gR2-

gt11gR2)bull Database setup configuration andor initialization parameters (eg SGAPGA

memory allocations)bull Database structural changes (eg adddropalter tables columns indexes and

views)bull Storage nature changes (eg start using partitions sub-partitions index organized

tables etc)bull New database feature usage (eg start using 11G optional OEM ldquoauto plan stabilityrdquo

features)bull Statistics andor histogram collection frequency granularity parameters andor

method (SQL command vs PLSQL package call)bull Relative size of the database (eg most databases grow over time ndash some grow

exponentially)

7

Managing Change

bull Measure of successndash Effective Results AFTER = BEFOREndash Efficient Performance AFTER ~= BEFORE

bull How to measure effectivenessndash Unit testingndash Integration testing

bull How to measure efficiencyndash Stress Testing (too often a simple hardware stress

scenario to prove that system can handle a ldquoloadrdquo)ndash Workload replay only way to assure real success

hellip

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

6

The Many Sources of Change

bull Hardware upgrades virtual resource re-allocation or virtual machine relocationbull Software upgrades (eg new operating system or update to virtual machine

software)bull Operating system andor virtual machine setup configuration andor initialization

parametersbull Database patches andor upgrades (eg 10203-gt10204 or Oracle 10gR2-

gt11gR2)bull Database setup configuration andor initialization parameters (eg SGAPGA

memory allocations)bull Database structural changes (eg adddropalter tables columns indexes and

views)bull Storage nature changes (eg start using partitions sub-partitions index organized

tables etc)bull New database feature usage (eg start using 11G optional OEM ldquoauto plan stabilityrdquo

features)bull Statistics andor histogram collection frequency granularity parameters andor

method (SQL command vs PLSQL package call)bull Relative size of the database (eg most databases grow over time ndash some grow

exponentially)

7

Managing Change

bull Measure of successndash Effective Results AFTER = BEFOREndash Efficient Performance AFTER ~= BEFORE

bull How to measure effectivenessndash Unit testingndash Integration testing

bull How to measure efficiencyndash Stress Testing (too often a simple hardware stress

scenario to prove that system can handle a ldquoloadrdquo)ndash Workload replay only way to assure real success

hellip

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

7

Managing Change

bull Measure of successndash Effective Results AFTER = BEFOREndash Efficient Performance AFTER ~= BEFORE

bull How to measure effectivenessndash Unit testingndash Integration testing

bull How to measure efficiencyndash Stress Testing (too often a simple hardware stress

scenario to prove that system can handle a ldquoloadrdquo)ndash Workload replay only way to assure real success

hellip

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

8

What is Workload Replay

bull Run the database application to generate transactions and capture those transactions for replay on the same or a different system

bull Focus the application transactions captured around that which has changed (ie a new business rule or process introduces new or modified code and database objects therefore run amp capture workload around that change)

bull Also advisable to capture an overall workload scenario so that bad side effects can be found

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

9

Traditional DBA Approach

Usually focused on just one or a

few SQL statements of

potential interest

Too Much amp Too Little

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

10

Too Much amp Too Little Explained

bull DBA most likely did not write the application code thatrsquos now running slowly (ie efficiency)

bull DBA may not fully understand the underlying business problem and all of its ldquorequirementsldquo (ie effectiveness)

bull 1+2 = Tune with Uncertainty (ldquoguestimaterdquo)bull Multiple changed dimensions or aspects of

the application and its database often rolled out all at once ndash overwhelming the lone DBA

bull Never enough time ndash Needs fixed Yesterday

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

11

Performance Pressure Points

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

12

Measure Cause amp Effect

ltltlt HOLD CONSTANT gtgtgtltltlt CHANGEgtgtgt

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

13

Options for Oracle Capture amp Replay

bull Oracle Real Application Testing (ie RAT)ndash Expensive (must purchase license for both source amp target)ndash Generally captures the ldquoentireldquo database workload (however

11gR2 offers some new amp useful replay filtering options)ndash Requires manually performing database backup amp recovery

bull Manual Trace File Capture via Toad DBA -gt Replayed by a Benchmark Factory Projectndash Requires DBA to perform all the capture work manually ndash

and this is not always easy (ie can be many many steps)

bull MOUSE (cute internal name for a new feature)ndash Automates the entire capture amp replay process (so BMF will

offer push button simplicity that even a caveman can do )ndash Offers extensive filtering on both the capture amp replay

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

14

RAT from Oracle New Features Training

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

15

RAT Base Pricing (minus discounts etc)bull CPU Cores CPU Cost Factor

Processor License Cost + software UpdateSupport fee

bull Must purchase for both source and targetbull Example (upgrading a Xeon DB server)

ndash Source Dual E5335 Quad 20GHz

2 4 5 $11500 + $000 = $46000ndash Target Dual E5650 Hexa 266 GHz

2 6 5 $11500 + $2530= $71530ndash OEM Diagnostic Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash OEM Tuning Pack (Target Only)

2 6 5 $5000 +$1100 = $61100ndash TOTAL Cost Base Pricing = $239730 ndash Assume Typical Discounting 30 = $167811

This is in

addition to

Databasersquos

base costhellip

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

16

Basic BMF Architecture Six simple steps

1 Manually setup to collect the trace files

2 Manually run the DB workload to capture

3 FTP trace files to Windows environment

4 Create BMF project based on trace files

5 BMF import (ie parse) the trace files

6 Run that project to replay the workload

1

2

3

4 5 6

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

17

Capture via Toad (Manual Effort)

Need both

of these so

that BMD

can replay

trace files

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

18

Capture via DB Trigger (Automated)

CREATE OR REPLACE TRIGGER AUTO_SET_TRACE

AFTER LOGON ON DATABASE

BEGIN

IF (USER IN (MOELARRYCURLY)) ONLY TRACE FOR THE 3 STOOGES

THEN

EXECUTE IMMEDIATE ALTER SESSION SET tracefile_identifier = XXXXX

EXECUTE IMMEDIATE ALTER SESSION SET max_dump_file_size = 10M

DBMS_SESSIONSESSION_TRACE_ENABLE (waits=gtFALSE binds=gtTRUE)

END IF

EXCEPTION

WHEN OTHERS THEN

RAISE_APPLICATION_ERROR(-10001AUTO_SET_TRACE ERROR)

END

You can write sophisticated filters to

limit the number size and naming (ie

prefix) of all trace files collected

during the capture

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

19

Inspect Trace Files via Toad

Much like

Winzip for

Trace files

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

20

Create BMF Project for Replay

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

21

Set Some Replay Parameters

Couple of Notes

- All the trace files need

copied from the database

server to the local BMF

Windows PC(s)

- The more and larger the

trace files the longer it will

take for BMF to parse and

load them

- BMF generally maintains

transaction ordering and

timings (but different

hardware software and

configurations may skew the

results as expected)

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

22

Run the Replay Job

So now we can replay or re-

run the captured database

workload at any time by

starting this BMF project

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

23

Irsquom Poor amp Lazy bull I donrsquot have $$$ for RAT (and OEM packs)bull I donrsquot want to manually do anything (ever)bull I want a very simple push button read my

mind totally automated solution that does not break the bank hellip

bull New BMF feature (Q4 ndash code name MOUSE)ndash Simple in concept amp totally automates the processndash Simple Capture Wizard (creates the BMF project)ndash Robust filtering options for both capture amp replayndash Merely replay the BMF project (it handles it all)ndash Zero percent manual effort (fully automatic)

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

24

BMF MOUSE Architecture

Look Familiar

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

25

New BMF Option Capture amp Replay

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

26

Create a Capture

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

27

Capture Wizard Steps

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

28

Capture Wizard Steps

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

29

Capture Wizard Steps

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

30

Monitoring the Capture

Manually Stop when

Done or by Schedule

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

31

BMF Job Built for You ndash Just Run It

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers

32

More informationbull Visit wwwToadWorldcom

ndash Expert blogs how-to-videos and more

bull Paper on topicndash httpwwwquestcomdocumentslandingaspxid=10998amptechnolo

gy=8ampprod=ampprodfamily=amploc

bull Benchmark Factory Communityndash httpbenchmarkfactoryinsidequestcomindexjspandash Interact with BMF users and the product developers