winops conf 2015 - john rakowski - militarise it for #devops success

Militarise IT For DevOps SuccessJohn Rakowski, Director of Technology Strategy

“Victorious warriors win first and then go to war, while defeated warriors go to war first and then seek to win”. Sun Tzu, 6 th Century BC

Copyright © 2015 AppDynamics. All rights reserved. 4

“You Never Know Where You Are Going Until You Know Where You Have Been” Will Smith, Will2k

http://i.huffpost.com/gen/1232576/images/o-WILL-SMITH-facebook.jpg


Two sides to measurement

Monitoring Metrics


Agenda

• Measurement and monitoring• Introducing situational awareness and OODA• Three capabilities to speed up OODA


What do we need to monitor?

Infrastructure

Databases

Applications

Users


Understanding the context


Applications are complex

Fast Release

Loyalty

Engagement

Revenue


Performance really matters


Performance really matters

11.6 seconds

24,000 releases

300 releases


Understanding the consequences


Understand the consequences

8th July 2015


How many enterprise monitoring products would you estimate your IT org owns?

65% have more than 10 products!

Source: EMA and AppDynamics Monitoring Survey, May 2015 , sample size = 302 IT professionals


Many tools equals “proactive” monitoring?

19% 44%

Source: EMA and AppDynamics Monitoring Survey, May 2015 , sample size = 302 IT professionals


Monitoring tools usually focus only on one metric

MTTR


Mean Time To Innocence

COSTPEOPLE | INFRASTRUCTURE

BRAND LOYALTY

THE WAR ROOM

£ is down

business

Network Not the DB ?? REVENUE

“Your app is slow!”

web database network


But the big issues are…

1/3Issues reported by end

users

77%Issues require 5+ people

hours to resolve

19

Source: http://thenextweb.com/wp-content/blogs.dir/1/files/2011/04/We-waited-30-min.jpg

Complaints like this are no more…

Application failures are very public in the software defined business

20


Agenda



Embrace situational awareness

“Knowing what is going on so you can figure out what to do”


Operate fast via OODA

Source: http://www.toledoblade.com/World/2003/03/22/Air-Force-pilot-s-ideas-shaped-modern-military-strategy.html

• Observe• Orient• Decide

• Act


OODA explained

Observations Decision Act

Traditions

New Info Past Exp

GenericHeritage

Analysis Synthesis

Observe Orient Act

Unfoldingcircumstances

Environment

Feed Forward

Feed Forward

Feed Forward

Feed Back

Unfolding interaction

Analytics DecideMonitoring


OODA applies across the organisation

Arch App Dev

Test/Release Ops

Plan and Design

Build Quality Assurance

Support

Business

MarketingProd Mgmt


Agenda



Three capabilities to speed up OODA

SEE ACT KNOWObserve and Orient

Feedback and Optimize

Decide and Act


Unified monitoring1) Transaction tracing and mapping

3) Application topology and visualization

4) Application monitoring

5) End User Experience Monitoring (EUEM)

6) Infrastructure Monitoring

7) Database monitoring

SEE

2) Business Transaction understanding

DevOps Collaboration

Automation On Emerging Issues

Compare Application Releases Easily

Ability to Collaborate In One Console

ACT


KNOW App-centric analytics

Performance Engagement

Value

OptimiseOODA

Top Product Categories

Customers by Tier

Average Response Time

£232,390Revenue Top Products

Revenue by cities

Customer breakdown

Total Revenues

Top Cities

Performance of every transaction

Optimise observe and orient


Optimise continuous delivery

Application Revenue

ApplicationResponse time

agilerelease 1

agilerelease 2

agilerelease 3

£44,499 per min

3.1 sec 1.9 sec

£54,499 per min


See, Act, Know across the organisation

Arch App Dev

Test/Release OpsBusiness

Customer Needs, Customer Feedback, New App And Release Information, New Feature Information, Bug Fix Info etc

Revenue Per Release, Customer Engagement, App Performance Information, Device Information, Crashes etc,


Conclusion

Source: http://i.ytimg.com/vi/9m35k2VLnlY/maxresdefault.jpg

• Measurement equals monitoring and metrics• Do you current monitoring tools provide situational

awareness?– Observe– Orient– Decide – Act

• Think See, Act, Know for situation intelligent response