Manuel HoßfeldLeitender Systemberater, Business Unit Database TechnologiesOracle Deutschland B.V. & Co. KG

Application Quality Management /Application Performance Management

Einleitung: APM / AQM – Worum geht’s?Annahme: Grundsätzliches Performance-Monitoring ist

da und funktioniert auch, aber meistens... rein Server-basiert reaktiv nur rückblickend

Idee: Wie wäre es wenn man.. ...die Perspektive des Endbenutzers berücksichtigen könnte? ...proaktiv geplante Veränderung testet bevor sich diese negativ

auswirken können? ...Monitoring, Analyse und Testing kombiniert einsetzen könnte -

„End to End“?

APM mit RUEI(Real User Experience Insight)

Business <-> IT „Disconnect“

What the business wants to know • How many users accessed my application in last x days?• How come only 1 out 8 people visiting the process actually logged a service request?• Which customers/partners did the orders come from?• What percentage of these orders did I process correctly and if an error occurred – what

error?

What IT can only respond with • The application was up 99% of the time• We had 200 concurrent sessions at peak load• Every server and service in the order management application met it’s performance and

availability SLA• When faults were logged, we are able to resolve them within 2 hours

User Experience Challenges

User Experience Management: 2 Approaches

2

True User Performance, all users, 24/7

Complete Session Reporting /Replay

Total application Coverage, all functions

Trend reporting, defined user

Service Availability Reporting

Cover many protocols / technologies

Recorded Sessions

1

Real User Monitoring

Synthetic Monitoring

Page response 2

Real User Monitoring: Session Capture

Client IP & Location

Requested URL

Cookie / Session ID

Source URL / POST & GET information

Response / Time?

TCP Status, Server Err, Website Err, etc

Content Scan of Body/Header

Delivered / Time?

User Abort

Network Timed Out

Page request

1

Browser Acks

3

Real User Experience Insight Reporting

• Geo-location Reporting• Enterprise Manager console data presentation• Executive dashboards• Extensive KPI and SLA monitoring• Full alerting capabilities

Some highlights

• Replay of Full User Sessions• Integrated Diagnostics• User Flow performance analyses• Customized reporting• Trend analyses• Full data integration with Oracle business Intelligence

Real User Experience Insight ReportingSome highlights

AQM mit ATS (u.a.)

(Application Testing Suite)

AQM Lösungen von Oracle

Testing Application Changes

Testing Infrastructure Changes

Test Data and Lab Management

Oracle Functional

Testing

Oracle Load

Testing

Oracle Test

Manager

SQL Performance Analyzer

Application Replay

Data Discovery and Modeling

Data Subsetting

Database Replay

Data Masking

New

New New

Oracle Application Testing Suite (ATS)

• Powerful, integrated solution for ensuring application quality.

Oracle Functional Testing

Oracle Test Manager Oracle Load Testing

• Supports: • Functional/regression testing• Load/Performance testing• Test Management• Web, Siebel, EBS/Forms, ADF, Adobe ® Flex, Database & WebServices

• Reduce scripting time by ~50%

Oracle Application Testing Suite 9.3

• Automatic script generation• Load/Performance test Scripts generated using RUEI and Real Application Testing

• Smart integration with EM Diagnostics• JVM Diagnostics for mid-tier

• DB Diagnostics for DB-tier

• DB Profiles for Oracle Database

Oracle OpenScript (ATS)

Mo

du

lesOpenScript

WebLoad

Functional

SiebelLoad

Functional

FORMSLoad

Functional

ADFLoad

Functional

????

Eclipse Platform

OpenScript Framework (API)

Fo

un

datio

n

…

Web

Services

Load

Functional

Existing JAVA Know-how

can be used to create

OpenScript modules...

-Adding functionality or

protocols to the platform

OpenScript

Graphic or Code View – Your ChoiceGraphic or Code View – Your Choice

Tester Perspective (Default)

Details View

Results View

Script View

Snapshot

Details View

• Provides additional info on script & playback results

• Info linked to nodes in Tree View• Page / window screenshots • Browser / HTML content• Request / Response headers

• Info linked to nodes in Results View• Script playback Results Report• Results for individual script nodes (screenshots, HTML,

headers)• Comparison view of record results vs. playback results

Results Report

Comparison

Functional Testing (ATS)

Oracle Functional Testing

Key Benefits

• Single unified scripting platform based on Oracle OpenScript

• JAVA/Eclipse based IDE

• Different perspectives/views• Non-technical users (GUI, declarative)• Technical users (JAVA code UI)

• Support for Web 2.0, SOA and Oracle applications

Easy to use, best-in-class functional test automation tool

OpenScript Data Table

Key Benefits

• Easier way to work with data driven scripts

• Manipulate test datafrom within OpenScript

New

Spreadsheet-like data table for Functional test scripts

OpenScript Object Details View

Key Benefits

• Structured view of all the objects of the selected modules, such as

• DOM tree of html pages• ADF UI Components tree for ADF applications• Forms element tree of a forms applications

• Accelerates viewing the object path, adding tests, and saving objects to an object library.

New

Accelerate working with objects and adding tests

Optimized testing for Oracle Applications

OpenScript

Web

ServicesFusion/

ADF

EBS/

FORMS

SiebelWeb Database Adobe ® Flex ®

Accelerators

Application Testing Suite Testing Accelerators

Automatic script creation for Oracle Applications

• ”Zero” effort load script creation for Oracle Applications

‒ No need to record scripts manually

• Support for Oracle e-Business Suite, Siebel, JD Edwards...

• Export real user sessions from Oracle Real User Experience Insight (RUEI) as Load scripts for Oracle Load Testing for realistic scenarios or synthetic testing of user sessions with issues...

Generate load test scripts from RUEI

Load Testing (ATS)

Oracle Load Testing

Key Benefits

• Oracle infrastructure included • Weblogic 11g• Oracle 11g Enterprise Edition

• Scalable automatic content validation

• Comprehensive performance monitors

• Web-based reporting interface• Easy to use real-time data views• Extensive analysis capabilities

Eliminate performance bottlenecks in your applications

Oracle Database and Java DiagnosticsOracle Enterprise Manager integration to Oracle Load Testing

Level 3: Measure Server-Side Transaction Performance with EM diagnostics

Level 2: Measure Infrastructure Performance under load with ServerStats

Level 1: Measure End-User Performance under load

Oracle Database Diagnostics Integration

Key Benefits

• Oracle Load Testing integration with Oracle Diagnostics Pack for Oracle databases

• ADDM & AWR reports directly in the Oracle Load Testing console

Easier database related trouble-shooting during load tests

New

Load testing – finding your bottlenecks...

Oracle Database

Application Under Test Oracle Load Testing

Monitoring the performance with Enterprise Manager

Bottlenecks are frequently found in the database tier (especially for packaged applications).Oracle Load Testing offers a unique integration into Enterprise Manager to simplifyidentification of these bottlenecks and automatic advice on how to address them.

• Tuning requires expertise and is time consuming• Performance and Workload Data Capture

• System Statistics, Wait Information, SQL Statistics, etc.

• Analysis• What types of operations database is spending most time on?

• Which resources is the database bottlenecked on?

• What is causing these bottlenecks?

• What can be done to resolve the problem?

• Problem Resolution• If multiple problems identified, which is most critical?

• How much performance gain is expected if ….???

Tuning Challenges

Run a load test against your application...

Monitor application through EM and OLT...

The tested applications database CPU load is high. This is seen in Oracle Load Testing’s ServerStats monitoring or external solutions like Oracle Enterprise Manager Grid Control

Access diagnostics reports from OLT

After the load test is completed:

The Automatic Workload Repository (AWR) and the Automatic Database Diagnostic Monitor (ADDM) reports for the selected session is loaded in the OLT console.

‒ AWR report provides a detailed

report of the statistics collected during the load session

‒ ADDM report analyzes snapshots taken by the AWR during the session to identify potential performance bottlenecks

Identify, impact, cause, recommendation...

ADDM report findings and Recommendations----------------------------

Finding 1: Hard Parse Due to Literal UsageImpact is .85 active sessions, 84.84% of total activity.--------------------------------------------------------SQL statements were not shared due to the usage of literals. This resulted inadditional hard parses which were consuming significant database time.

Recommendation 1: Application AnalysisEstimated benefit is .86 active sessions, 84.84% of total activity.-------------------------------------------------------------------ActionInvestigate application logic for possible use of bind variables insteadof literals.ActionAlternatively, you may set the parameter "cursor_sharing" to "force".

Identifies the performance bottlenecks

Estimates the impact of the problem

Drills down to the root cause

Gives recommendations & suggests the estimated

benefit

Provides specific actions to correct the problem

Weitere Informationen

• Application Quality Management im OTN:http://www.oracle.com/technetwork/oem/app-quality-mgmt/index.html

• Application Performance Management im OTN:http://www.oracle.com/technetwork/oem/app-performance-mgmt/index.html