piper-rx new zealand oracle users group conference 2010 effective oebs application monitoring and...
TRANSCRIPT
PIPER-Rx
www.piper-rx.com
New Zealand Oracle Users Group Conference 2010
Effective OEBS Application monitoring and management –
latest news, views and techniques
ByGary PiperMarch 2010
PIPER-Rx
www.piper-rx.com
Agenda…
Recent trends impacting OEBS Applications monitoring and management
Better OEBS management – free code & reports Workflow User activity profiling Performance Concurrent manager activity
Change the way you think about Applications management
PIPER-Rx
www.piper-rx.com
Managing OEBS is like a frog in a pot…
Stick a frog in boiling water and it jumps out, stick it in cold water and very slowly bring to a boil and it dies
Why? - Its body temperature keeps adapting to the surrounding slow change in temperature. The frog does not know that the temperature can rise so high it will collapse under the heat. It feels nice and comfortable at each point on the road to death
“We don’t know what we don’t know”
The challenge for DBAs, Apps DBAs and IT managers is to know how hot the water isThe challenge for DBAs, Apps DBAs and IT managers is to know how hot the water is
PIPER-Rx
www.piper-rx.com
OEBS Applications management trends…
Improvements in OEBS Applications management in the last few years have been limited
Workflow is still a problem child
User behavior has not changed
Monitoring tools that include OEBS have become bigger and more complex and still largely take us down a technical path
PIPER-Rx
www.piper-rx.com
OEBS Applications management trends… The problem with the current crop if OEBS tools as I see it
is: The market direction has moved a way from point products to
massive “all seeing all knowing” enterprise monitoring, SLA, SOA, CMDB etc… tools
Tools do lots of “cool” stuff• unfortunately there is so much cool stuff you end up only using the bits you are
familiar with. So you do the same stuff, only more efficiently Tool complexity requires a greater learning investment - you need to
be quite experienced to understand the output…and who has that time?
You ignore the output because you get too much of it – (index rebuild example)
“Its what you do with the information that makes the difference”. If you don’t have the information in a form that is easily understood it is relatively useless
• The output needs to be in a format that can be communicated to the business users (NB: The business is not IT)
We still don’t know what we don’t know……
PIPER-Rx
www.piper-rx.com
What you want and what you get….
I want to monitor my OEBS application What's available are enterprise monitors
I wanted a shovel and I get a D9 earth mover But WOW, all the cool stuff you can do with the D9
PIPER-Rx
www.piper-rx.com
What occurred in the market that took us here?…
Oracle 10g & 11 – Self managing you wont need a DBA RAC
Vendors were predominantly database based - Even though OEBS did not support this architectures for some time
Enterprise monitoring Record and play back
• The repository became larger than the instance - Solved by Appliances – Central repository
Sarbanes-Oxley Act 2002 CMDB Configuration and vulnerability tools – (One tool even measured high buffer gets as part of the vulnerability
tool) Database Activity Monitoring – table level changes – (the SQL) Casting doubt on your accounting controls is often much less sophisticated Eg Unposted batches
Mergers & SAP PeopleSoft, Siebel, Oracle purchases Many of these products also required vendor solutions
SLA & SOA Service orientated architecture - if something is wrong who or what will be / is affected
Most companies do not have an SLA let alone an enterprise wide SLAs Service level and event
• If I have some idiot run X jobs the whole system is affected• If the database is down the whole Application is down.
Virtualisation Fusion This will get you audited within an inch of your life
Casting doubt on your accounting controls is often much less sophisticated
360Commerce AdminServer Advanced Visual Technology (AVT) Agile AppForge AutoVue BEA Bharosa Crystal Ball Bridgestream Captovation ClearApp Context Media Demantra e-Test (acquired from Empririx) Global Knowledge Software (GKS) G-Log Haley HotSip Hyperion iFlex Innobase Interlace Systems JD Edwards EnterpriseOne JD Edwards World LODESTAR LogicalApps
MetaSolv Moniforce mValent Net4Call Netsure Telecom Limited Oblix OctetString PeopleSoft Portal Software Primavera ProfitLogic Relsys Retek Siebel Sigma Dynamics Skywire Software Sleepycat Berkeley DB Stellent SPL WorldGroup Sun Microsystems (pending) Sunopsis Tacit Software Tangosol Telephony@Work TempoSoft TimesTen in Memory DB Thor Technologies TripleHop
Oracle – acquired companies…
Source: http://www.oracle.com/us/products/index.htm (Oct-2009)
PIPER-Rx
www.piper-rx.com
Oracle E-Business Suite Ecosystem…
Full Service Self Service
Self ServiceCustomers
ArchitectureArchitecture
DatabaseDatabase
Fin, PO,OE,HR,PA….Fin, PO,OE,HR,PA….
WorkflowWorkflowConcurrentConcurrentProcessingProcessing
ApplicationApplication
Apps DBATuning : Patching : Cloning : “Cool” : Upgrades : Maintenance : Capacity Planning : Development :
Professional Development : Change Control : Backups : DR Planning And Other
ManagementReporting
(Technical)
Support
Customer Support
ManagementReporting(Business)
ManagementReporting(Business)
UPGRADES
MergersTakeovers
Business Growth
Interfaces
Development
COMPLIANCE
PIPER-Rx
www.piper-rx.com
And what do we have to help us?… Our D9 – which is great if we want to build a road… An enterprise tool sign-off process that takes years
Live with cra# for 2 years then decide to buy a tool it that takes 1 year to purchase The Oracle and OEBS portions of tools are generally designed by DBAs for
DBAs. There are rare acceptations but in most cases the OEBS stuff is buried so deep in a technical tool you cannot find what you want
SLA - SOA breaches If your Application is slow its all slow… If some idiot users runs X jobs, the whole application
is affected Number of alerts raised
This is fine from a database / network approach when items are monitored 24/7 CPU…. OEBS – Once per month # of unposted journals Index rebuilds Aged user accounts SLA breach on the last day of each month SLA levels set for month end processing, miss the middle of the month
When a tool tells you something is wrong.. It often Doesn’t tell you what to do about it Doesn’t provide the information in terms a business user can understand
I even remember one tool company saying you need to hire a tool manager
PIPER-Rx
www.piper-rx.com
and then came the GFC… There's now no money for new tools…
Dow Jones Industrial Average ASX
The climate is still uncertain? Who has any budget? How will the vendors ride this out? Where will their development effort be?
PIPER-Rx
www.piper-rx.com
Today’s practical approach to OEBS management:Get back to basics…
Start by getting a handle on your processing profile Overall activity / usage patterns covering a full business
cycle The great thing about OEBS implementations is that they are so
predictable - if it was slow on day 2-4 of last month end you can be sure it will be slow on days 2-4 this month end
Idiot user actions - a constant challenge to monitor and manage
Forget the new stuff and get the current stuff working properly first
If you’re an OEBS DBA and still primarily living in SQL land – you may want to rethink your strategy
PIPER-Rx
www.piper-rx.com
Paradigm shift: Change the way you think about Applications management …
IssueIssue
Technical User Activity
“In a stabilised environment the majority of performance issues are user related”
SELECT /*+ ORDERED USE_NL(cc bal) INDEX(per GL_PERIOD_STATUSES_U2) INDEX(bal GL_BALANCES_N1) */ MAX (bal.period_name) period_name, SUM (NVL (bal.begin_balance_dr, 0)) begin_dr, SUM (NVL (bal.begin_balance_cr, 0)) begin_cr, SUM (NVL (bal.begin_balance_dr, 0) + NVL (bal.period_net_dr, 0) ) end_dr, SUM (NVL (bal.begin_balance_cr, 0) + NVL (bal.period_net_cr, 0) ) end_cr FROM gl_period_statuses per, gl_code_combinations cc, gl_balances bal WHERE cc.segment11 BETWEEN '00' AND '11' AND cc.chart_of_accounts_id = :struct_num AND per.application_id = 101 AND per.set_of_books_id = :p_set_of_books_id AND per.effective_period_num BETWEEN :start_effective_period_num AND :end_effective_period_num AND bal.code_combination_id = cc.code_combination_id AND bal.period_name = per.period_name AND bal.actual_flag = :p_actual_flag AND budget_version_id = 1000 AND 1 = 1 AND bal.set_of_books_id = :p_set_of_books_id AND bal.template_id IS NULLGROUP BY per.period_year, per.period_numORDER BY per.period_year, per.period_num
SELECT /*+ ORDERED USE_NL(cc bal) INDEX(per GL_PERIOD_STATUSES_U2) INDEX(bal GL_BALANCES_N1) */ MAX (bal.period_name) period_name, SUM (NVL (bal.begin_balance_dr, 0)) begin_dr, SUM (NVL (bal.begin_balance_cr, 0)) begin_cr, SUM (NVL (bal.begin_balance_dr, 0) + NVL (bal.period_net_dr, 0) ) end_dr, SUM (NVL (bal.begin_balance_cr, 0) + NVL (bal.period_net_cr, 0) ) end_cr FROM gl_period_statuses per, gl_code_combinations cc, gl_balances bal WHERE cc.segment11 BETWEEN '00' AND '11' AND cc.chart_of_accounts_id = :struct_num AND per.application_id = 101 AND per.set_of_books_id = :p_set_of_books_id AND per.effective_period_num BETWEEN :start_effective_period_num AND :end_effective_period_num AND bal.code_combination_id = cc.code_combination_id AND bal.period_name = per.period_name AND bal.actual_flag = :p_actual_flag AND budget_version_id = 1000 AND 1 = 1 AND bal.set_of_books_id = :p_set_of_books_id AND bal.template_id IS NULLGROUP BY per.period_year, per.period_numORDER BY per.period_year, per.period_num
XX
PIPER-Rx
www.piper-rx.com
Getting started towards better OEBS Apps management…
“How to” in 4 crucial areas (free reports):1 – Workflow
2 - User activity profiling
3 - Performance & the affect of an issue
4 - Concurrent manager activity
Every report provided with this paper does not require any recording. The information is already there in your OEBS application.
PIPER-Rx
www.piper-rx.com
1 - Workflow…
NZOUG Mar-2010 Paper “A better approach to OEBS workflow management”
It starts with managing workflow using accounting’s “aging” principles
Trick is excluding all those workflows that are “old” and will not be cleaned up in the near future
Excellent source of business performance KPIs
PIPER-Rx
www.piper-rx.com
2 - User activity profiling…
How many user accounts are actually being used and more importantly when? How many active/inactive application accounts are there? How do usage patterns vary / increase over time?
Aged Application users Clean them up (security) Makes you look good
Who are your top users? (You need appear to support these people)
Very important profiling information
PIPER-Rx
www.piper-rx.com
Free user activity reports…
www.piper-rx.com/pages/reports_free.html
PIPER-Rx
www.piper-rx.com
User activity profiling…
SQL & Spreadsheet
Self Service Activity
0
0.2
0.4
0.6
0.8
1
1.2
0:00
1:00
2:00
3:00
4:00
5:00
6:00
7:00
8:00
9:00
10:0
0
11:0
0
12:0
0
13:0
0
14:0
0
15:0
0
16:0
0
17:0
0
18:0
0
19:0
0
20:0
0
21:0
0
22:0
0
23:0
0
10-Oct-09 (Sat)
09-Oct-09 (Fri)
08-Oct-09 (Thu)
07-Oct-09 (Wed)
07-Oct-09 (Tue)
06-Oct-09 (Mon)
05-Oct-09 (Sat)
Full Service Activity
0
0.5
1
1.5
2
2.5
3
3.5
0:00
1:00
2:00
3:00
4:00
5:00
6:00
7:00
8:00
9:00
10:0
0
11:0
0
12:0
0
13:0
0
14:0
0
15:0
0
16:0
0
17:0
0
18:0
0
19:0
0
20:0
0
21:0
0
22:0
0
23:0
0
29-Oct-09 (Thu)
28-Oct-09 (Wed)
08-Oct-09 (Thu)
07-Oct-09 (Wed)
07-Oct-09 (Tue)
06-Oct-09 (Mon)
05-Oct-09 (Sat)
PIPER-Rx
www.piper-rx.com
The future?...
Company 1 Self Service Users
PIPER-Rx
www.piper-rx.com
3 - Performance & the affect of an issue...
It’s SLOOOOW!!!! The first and biggest issue is what does “IT” and “slow” mean? Users just want a simple, fact based answer - No its not / No it
was not / Yes it was and we are looking into it.
“Not all performance complaints are technical”
Performance… In the zest to develop the holy grail of end-2-end and route
cause analysis - we have forgotten the end user. We need something they can understand. Try using FNDOAMCOL
PIPER-Rx
www.piper-rx.com
3 - Performance & the affect of an issue...
www.piper-rx.com/pages/reports_free.html
PIPER-Rx
www.piper-rx.com
3 - Performance & the affect of an issue...
There are three basic categories Performance issue now Performance issue yesterday Outage
You need to know What is running and who is connected What was running and who was connected
Look for Duplicate requests Long running requests External users
PIPER-Rx
www.piper-rx.com
3 - Performance & the affect of an issue...
PIPER-Rx
www.piper-rx.com
3 - Performance & the affect of an issue...
External Users User account
Person (Employee) Customer Supplier Requires SQL for reports (ECS)
User Description Set a standardised user description User can change their description via self service session
'('||decode(employee_id, null ,'-', 'E')|| decode(customer_id, null ,'-', 'C')|| decode(supplier_id, null ,'-', 'S')||')' user_type
'('||decode(employee_id, null ,'-', 'E')|| decode(customer_id, null ,'-', 'C')|| decode(supplier_id, null ,'-', 'S')||')' user_type
PIPER-Rx
www.piper-rx.com
4 - Concurrent manager activity…
You need to know three things:
What are you actually running? What are the slowest programs? (these are
likely to jam up managers) Are there requests that are assigned to the
wrong manager?
All new code should be assigned to the “slow” manager until it earns the right to be migrated to the standard manager
PIPER-Rx
www.piper-rx.com
Request Activity profiling…
www.piper-rx.com/pages/reports_free.html
PIPER-Rx
www.piper-rx.com
Request run times…
PIPER-Rx
www.piper-rx.com
Summary…
Identify the heat sources Turn down the heat Keep it tidy Keep it clean He who has the most charts wins…
SAVE THE FROG
PIPER-Rx
www.piper-rx.com
Disclaimer…
The material contained in this presentation and any accompanying documents is provided by the author "as is" and any express or implied warranties, including, but not limited to, any implied warranties of merchantability and fitness for a particular purpose are disclaimed. In no event shall the author be liable for any direct, indirect, incidental, special, exemplary, or consequential damages (including, but not limited to, loss of use, data, or profits; or business interruption) however caused and on any theory of liability, whether in contract, strict liability, or tort (including negligence or otherwise) arising in any way out of the use of any content or information, even if advised of the possibility of such damage. It is always recommended that you seek independent, professional advice before implementing any ideas or changes to ensure that they are appropriate.
TOAD® is a registered trademark of Quest Software. Oracle® is a registered trademark of Oracle Corporation
© 2009 G Piper All Rights Reserved
PIPER-Rx
www.piper-rx.com
Clip art source…
Boiling Frog Picture http://www.danablankenhorn.com/2006/08/the_power_of_th.html
Shovel http://www.dmiblog.com/
Spider - Free Halloween Clipart http://halloween.whipnet.net/clipart