kellyn pot'vin-gorman - power awr warehouse2
TRANSCRIPT
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 2
Enterprise Manager 12.1.0.5 is OUT! Have questions, feel free to ask me or check out the release blog post:
https://blogs.oracle.com/oem/entry/new_enterprise_manager_release_allows
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential
The Power of the AWR Warehouse and BeyondLong Term Database Performance Analysis for Oracle Databases Using AWR Warehouse
Kellyn Pot’Vin-GormanConsulting Member of Enterprise Manager Technical TeamStrategic Customer ProgramJune, 2015
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor StatementThe following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
Oracle Confidential 5
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 6
Program Agenda
1
2
3
4
5
Why Have an AWR Warehouse
Architecture
ETL
EM Interface Features
Advanced Usage of the AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 7
Program Agenda with Highlight
1
2
3
4
5
Why Have an AWR Warehouse
Architecture
ETL
EM Interface Features
Advanced Usage of the AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 8
Why a Warehouse?
1. Centralized location offers space savings to retain AWR data in source database and it’s SYSAUX tablespace.
2. Centralizing the data, identified by Database identifier, host, allows analysis on more than one database/host without database links.
3. Ease of management of AWR snapshots, redundant location of AWR performance data.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
AWR Warehouse in EM12c• Automatic Workload Repository
(AWR) is the de facto performance repository for Oracle databases since 10g
• Default retention period of 8 days prevents diagnosis of long term performance problems (“Compare performance during this quarter’s books close with last quarter’s”)
• Increasing AWR retention period increases overhead and demands on critical production systems.
CRMFinance Supply Chain
0%
30%
60%
90%
120%
0%
30%
60%
90%
120%
0%
30%
60%
90%
120%
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 10
Requirements
• Preferred Credentials set up for all targets involved.
• Discover the database you will use for your repository in the EM12c or EM CLI commands.
• Pre-discover any source database before able to add.
• For a RAC target or AWR Warehouse, ensure you’ve set up a shared location for the ETL load files.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 11
AWR Repository Versions
AWR Warehouse Repository database must be 11.2.0.4 with patch, but recommended version is database 12.1.0.2.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 12
Requirements, Cont.• Will support source databases,(targets) 10.2.0.4 12.1.0+• Version 12.1.0.4.3 (OMS System Patch 19391521 )• AWR Warehouse Master Note 1907335.1• Requires diagnostic pack. With this, limited EE license for use of AWR
Warehouse Repository database, (Not to be confused with OMR.) • As long as no additional, (RAC, Dataguard, etc.) on AWR Warehouse
repository database, the limited EE license will support.• Plan out on separate hardware from the Oracle Management Repository
and Oracle Management Service for Enterprise Manager 12c!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 13
Program Agenda with Highlight
1
2
3
4
5
Why Have an AWR Warehouse
Architecture
ETL
EM Interface Features
Advanced Usage of the AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
AWR Warehouse - Architecture• Central warehouse configured for
long term AWR data retention• Historical and ongoing AWR
snapshots collected from databases enabled for AWR warehouse• ETL jobs moves snapshots from
source databases into AWR warehouse• Retention period configurable for
weeks, months, years or indefinite retention (default)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 15
How Do I Size My AWR Warehouse?
• Use the $ORACLE_HOME/rdbms/admin/awrinfo.sql to gather information about current SOURCE database AWR data size.• Decide how much data you want to retain- indefinite? 2 years? 1 year? 6
months?• Outside of default retention, you can set retention per database- consider
different retention for dev or test vs. production in the repository.• Size out with retention padding included. Different database versions will
require different sizing demands, 10g=smaller, (around 4-18Mb per day) vs. 12c=larger, (about 24-48Mb per day.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 16
Why Use the General AWR Informatin Report?• Break down of not just size, but components making up the AWR.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 17
Program Agenda with Highlight
1
3
2
4
5
Why Have an AWR Warehouse
Architecture
ETL
EM Interface Features
Advanced Usage of the AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 18
AWR ETL Jobs
DBMS Scheduler Job on Source Database to directory
Job in EM Job Service that pulls file from Source Target and then pushes to AWR Warehouse Target Directory Final DBMS Scheduler Job
Inserts data into AWR Warehouse
All data identified by OLD/NEW DBID and with the EM_ID, (CAW_DBID_MAPPING in AWR WAREHOUSE)
Source Target
Enterprise Manager
AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 19
Source Database ETL Job
DBMS Scheduler Job Name: MGMT_CAW_EXTRACT
Exec Call: begin dbsnmp.mgmt_caw_extract.run_extract; end;
How Often: 3 Hour Intervals if “playing catch up”, otherwise, 24 hr interval.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 20
EM12c EM Job
• Agent to agent push.
• No other interaction with EM12c outside of interface.
**CAW Naming Convention- Centralized AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 21
AWR Warehouse ETL Load Job
DBMS Scheduler Job Name: MGMT_CAW_LOAD
Exec Call: begin dbsnmp.mgmt_caw_load.run_master;
How Often: 5 Minute Intervals to check for file, once every 24hrs to match extract file transfer when checking run times.
Biggest Resource Demand from the “run_master”:
begin dbms_swrf_internal.move_to_awr(schname => :1); end;
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 22
New DBSNMP Objects
CAW_EXTRACT_PROPERTIES : Information on ETL job, dump location and intervals.
CAW_EXTRACT_METADATA : All data about extracts- times, failures, details.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 23
Program Agenda with Highlight
1
4
2
3
5
Why Have an AWR Warehouse
Architecture
ETL
EM Interface Features
Advanced Usage of the AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 24
Accessing
• First access, will be asked to set up AWR Warehouse to database.• Have database for repository and default credentials setup beforehand.• Request to add first source database to repository.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
AWR Warehouse Interface• Warehouse dashboard tracking
ETL jobs• All AWR features available on long
term AWR data• Performance page• AWR report• ASH analytics• Compare Period Report
• Integrated seamlessly into EM UI• Zero runtime overhead on source
Production databases
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 26
How Do You Know You are Using it?
• Upper right hand corner drop down
• Can switch between and if non-existent, console will inform the user.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 27
AWR Warehouse ConfigurationsAlong with AWR Warehouse Basics-
• Configuration Status
• Version of Repository Database
• Host Information
• Connect Info, (SID/Service Name, Port)
• Space Usage, Upload Interval and Retention
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 28
Snapshots
View snapshot loads per day
High loads due to catch up, new source db’s.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 29
Database Details
• Database, go to DB Details Page
• DB Type, DB Name, Version, Owner, Enabled
• Snapshot Information
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 30
Upload Information
• Add
• Highlight, Remove
• Highlight, View Errors
• Privileges to Manage Snapshots
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 31
Snapshot Information
• Oldest timestamp
• Newest timestamp
• Days of Snapshots
• Count
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 32
Database List
Clicking on Target Name will TAKE YOU TO DB Performance Home Page!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 34
ETL Load Errors
Good!!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 35
Managing Snapshot Privileges• Viewing Access
• Manage Snapshots
• Retention Time
• Removal of Snapshots
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 36
AWR Performance Features
•ASH Analytics
•AWR Report
•Comparison Period, (aka ADDM Comparison)
•Database Performance Home
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 37
ASH Analytics
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 38
ASH Analytics
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 39
The Load Map
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 40
Advanced Load Map
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 41
Ash Analytics Change Detail
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 42
AWR Report
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 43
Combined and By Instance
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 44
Top SQL by Elapsed Time
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 45
Run an AWR Report…• For any time that data exists in the AWR Warehouse.• Review execution performance from previous financial
periods.• Review execution performance from previous retail
seasons.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 46
How Often do We Ask, “What Changed?”
• It ran fine last week, now it isn’t!
• ETL loads have changed, but no one has released any new code!
• The DBA says there hasn’t been any parameter changes to this database, but I’m sure there have been.
Compare Period ADDM Resolution
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 47
What is Compare ADDM?
• Uses Two AWR snapshots
• Creates Report that-
• Compares SQL that is common and different.
• SGA changes
• IO/CPU bound issues
• Parameter Changes
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 48
A Comparison ADDM Report…
• Report Includes Following:• Clear Demonstration of impact of change.• Recommendations to address issue.• Identifies causes behind change, (with limitations.)• Lists Regressed SQL, too!
Tip: If Installing to pre-db12c database for first time, (simple installation, nothing to concern about, just pkg to fulfill views) you must have preferred credentials SET of install will fail!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 49
Performing a ComparisonYes, you can compare one snapshot against another snapshot in DIFFERENT database!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 50
2-3pm, Compared on the 12th vs. the 13th
• Familiar interface with visual wait event comparisons.
• Average # of sessions during each period are displayed.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 51
Detailed Report
High level data, highlight for analysis and recommendations
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 52
Regression SQLAny performance degradation is noted with the down arrow icon-
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 53
Top Segments Causing IO Waits
• High Level data• Click on “Show Hot Object Breakdown” to see more detail.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 54
Resource Comparisons• Comparisons of Memory, CPU, IO and Interconnect.
• Memory Is there Virtual paging?
- Memory Base Period
- Memory Comparison Period
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Dashboard Provided for CPU, Memory, IO and Interconnect• Is something OTHER than Oracle the cause?
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
IO Bound Dashboard• Base vs. comparison period• Temp reads/writes specified• Single block read latency
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 57
Performance Home
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 58
Historical ASH
No Data! Future Release…
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 59
Program Agenda with Highlight
1
5
2
3
4
Why Have an AWR Warehouse
Architecture
ETL
EM Interface Features
Advanced Usage of the AWR Warehouse
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 60
Centralized AWR Warehouse Objects
Simple and clean schema edition to the DBNSMP.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential – Internal/Restricted/Highly Restricted 61
What Can I do with the AWR Warehouse?
16:5916:5917:2917:2917:5917:5918:3018:3019:0019:0019:3019:3020:0020:000
50000
100000
150000
200000
250000
300000
350000
400000
June 10, 2013
l_reads_s read_iops_maxread_iops_direct read_iops_direct_max
20:3020:30
20:5920:59
21:3021:30
22:0022:00
22:3022:30
23:0023:00
23:3023:30
23:5923:59
0:290:29
0
100000
200000
300000
400000
500000
600000
June 10, 2014
l_reads_s read_iops_maxread_iops_direct read_iops_direct_max
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 62
CPU Usage Issues
“Nothing’s changed in months…”
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 63
Using the AWR Warehouse for Capacity Planning
“Do we really need more partitioning and pruning? Our disk usage hasn’t increased this last year….”
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 64
CAW_DBID_MAPPING Table
Most important table for anyone querying the AWR Warehouse!
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 65
Querying the AWR Warehouse Tips
Update Scripts with DBID identified to filter.
Join:
• CAW_DBID_MAPPING on OLD_DBID/NEW_DBID=DBID
• CAW_DBID_MAPPING on TARGET_NAME=TARGET_NAME
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 66
How Current AWR Queries Change
from dba_hist_sys_time_model stm, dba_hist_snapshot s, gv$parameter p, dbsnmp.caw_dbid_mapping m
where stm.stat_name in ('DB CPU','background cpu time')
and LOWER(m.target_name)= '&dbname'
and s.dbid= m.new_dbid and s.snap_id = stm.snap_id
and s.dbid = stm.dbid and s.instance_number = stm.instance_number
and p.name = 'cpu_count' and p.inst_id = s.instance_number)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Updating Existing AWR Queries to Go Across Hosts
select * from (selectm.target_name,sum(CPU_TIME_DELTA),sum(DISK_READS_DELTA),count(*)fromDBA_HIST_SQLSTAT a, dba_hist_snapshot s, dba_hist_database_instance di, dbsnmp.caw_dbid_mapping mwhere di.host_name='&host'and di.dbid in m.new_dbidand m.new_dbid = a.dbidand a.snap_id = s.snap_idand s.begin_interval_time > sysdate -120group by m.target_nameorder bysum(CPU_TIME_DELTA) desc)
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. |
Graphing CPU Usage Per DB for One Host
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 70
SQLTXPLAIN and SQLd360 with the AWR Warehouse
•SQLd360 runs out of box, but host and db info is from AWR Repo.
•SQLT requires changes to package and executables before XPRECT and XTRACT will run successfully.
•SQLT will require installation change- When asked if has “tuning pack”, with option “T”, instead will state “A” for AWR Warehouse installation that will then install different SQLT$A package and executables for AWR calls.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 71
SQLTXPLAIN and the SQLT$A Package
•Function get_database_id updates to pass in p_dbname and then call from DBA_HIST_DATABASE_INSTANCE.
•Same for other functions that pull the instance, host and other info in the package.
•Updated the executables to add parameter for the database name
•Recompiled the package and updated the SQL in the directories.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 72
SQLd360
•No installation of the product, all code in directory
•Recommended to change the execution to include an “A” option for AWR Warehouse, which will then use a different “PRE” script.
•Pre script will use the database name to call the AWR objects instead of V$DATABASE/V$INSTANCE/GV$** and then run everything correctly.
•Easier to change than the SQLT product.
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 73
Future of AWR Warehouse
•IT Analytics?
•Network and Host Level Data?
•EM Raw Metric Data?
•SQTEXPLAIN and SQLd360
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 74
AWR Warehouse Scripts at DBAKevlar.com
Adding more scripts as time goes by…
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 75
Want to Learn More?
Oracle Screenwatch: https://www.youtube.com/watch?v=StydMitHtuI
DBAKevlar Blog Posts:
Blog Search: http://dbakevlar.com/tag/awr-warehouse/
Scripts: http://dbakevlar.com/scripts/
Oracle Documentation: http://docs.oracle.com/cd/E24628_01/server.121/e55047/tdppt_awr_warehouse.htm#TDPPT145
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Oracle Confidential 76
Connect with me via Social Media: