Peter TsatsaronisDelivery ManagerNAB

Aruna RavichandranVP Product Marketing , APM & DevOpsCA Technologies

National Australia Bank (NAB) : How we used CA APM during performance testing to improve

transaction performance by 85%

NAB Transformation

Technology Centric Tools

Application Performance Management

DevOps

Agenda

Imminent Future is Customer Centric

1

2

3

4

5

Our Financial Services Business

17thLargest Bank Globally

12+ Million Customers

42,000 Employees

1,800+ Stores/Branches

10 Countries of Operations

Laser Focus on the Customer

JOURNEYTECHNOLOGY TRANSFORMATION

Stage 2APM in Dev

Stage 3DevOps

Bank Evolution Technology Transformation Journey

Stage 1Technology Centric

Tools

RESULTS

User Experience Suffers

2009

RESULTS

Great User Experience

2011

RESULTS

User Experience as Differentiator

2014

Stage 1: App Focused – Web Interface Into Bank

Technology

IT Operations • Home grown or multiple

vendors• Feature specific , no integration

App Development• Dev centric• Function specific (dev, QA, etc.)

Challenges• Limited visibility in customer

experience• Reactive “User-Based” alerting• Hard to identify problematic app• hotspots

Organization

IT Operations

APP PERFORMANCE & PROBLEM RESOLUTION

Service Delivery

Infrastructure

Network

Change Management

Other Teams…

Sep

arat

ed

To

ols

an

d G

rou

ps

Application Development

APPLICATION ROLLOUT

& LIFECYCLE

Development

Testing

Technical Service Management

Solution Design

Other Teams…

Dif

ficu

lt C

om

mu

nic

atio

n

• Siloed tools and teams

• No cross-team visibility

FASTERWE CAN DELIVER APPLCIATIONS

Stage 2: App Issues – Identify Early, Resolve Fast

Technology

IT Operations • Home grown or multiple

vendors• Feature specific , no

integration

App Development• CA APM implemented in

pre-production (Introscope, End User Experience)

Benefits• Fast App Delivery!• Faster troubleshooting,

deep app visibility• Simple transaction

performance optimization

Organization

IT Operations

APP PERFORMANCE & PROBLEM

RESOLUTION

Service Delivery

Infrastructure

Network

Change Management

Other Teams…

Imp

rove

d C

om

mu

nic

atio

n

App Development

APPLICATION ROLLOUT

& LIFECYCLE

Un

ifie

d D

eve

lop

men

t

• Improved communication between Dev

and ops

• Predictable Dev SLAs

• Still…siloed tools and De/Ops teams

App Development

Testing

Service Management

Solution Design

Other Teams…

• CA APM agents deployed on 80+ servers in 5 days

• 2 hrs. to build service-centric CA APM Dashboard

Solution -> Deploy CA APM in Pre-Production

Pre-Production Success - UBankLogin and Origination Transaction Performance

Situation

• Dev team spent 4 weeks troubleshooting UBank R2A performance issue

• 80+ servers - collecting log files across

• Network packet capture

• Manually correlating performance data

Challenges

• Heavy resource involvement

• Little improvement or direction to resolution

• No progress on Dev side

• Delays with App rollout

Pre-Production Success UBank - CA APM In Action

OSB Dashboard

• Dev team spent 3 weeks troubleshooting UBank R2A performance issue

• 80+ servers - collecting log files across

• Network packet capture

• Manually correlating performance data

• Drill-down from UBank Dashboard

• Out of the box, no config required

Transaction Tracing

• Within an hour of tracing “Login”, several problematic components identified

• From 30, narrowed to 2 Oracle transaction components

• Eliminated the need to investing 10+ backend systems

Time to Value

• Fast and scalable install (80 servers, 5 days)

• Simple configuration, running in under two hours

• Immediate actionable information, transaction tracing configured out-of-the box

Pin Point Focus

• Reduce number of of components we need to investigate from 30 to 2

• Eliminate the need for investigating 10+ back end systems

Pre-Production Success UBank - Service Measurable ResultsFaster app delivery, improved app performance

Project Improvements

Project back on track (from Risk)

2 weeksElapsed time is 4 weeks

Actual APM effort only

App Performance

82%faster

Login transaction performance

2.3seccompared to before APM

Login time reduced by

HARMONYDEVOPS BRING IS IT ALL TOGETHER IN

Stage 3: DevOps – Share the Goodness Across the Boundaries

Technology

IT Operations • CA APM, Cloud Monitor

deployed in production

App Development• Addition of CA Service

Virtualization, CA Application Test to CA APM in pre-production

Benefits• Fast App delivery, great

quality, seamless user experience

• Preemptive problem resolution

• Cost is minimized and team efficiency improved

Organization

IT Operations App Development

• Single Tools, Single Team!

• Org structure is optimal for agile development and operations

APP PERFORMANCE & PROBLEM RESOLUTION

Service Delivery

Infrastructure

Network

Change

Management

Other Teams…

APPLICATION ROLLOUT & LIFECYCLE

Infr

astr

uct

ure

Man

agem

ent

Un

ifie

d D

ev a

nd

Op

s To

ols

No

Co

mm

un

icat

ion

Bar

rie

rs

Development

Testing

Tech Service

Management

Solution Design

Other Teams…

CA

AP

M, C

A C

lou

d M

on

ito

r

CA

AP

M, C

A L

ISA

Dev Fu

nctio

nal To

ols

Dev and Ops “talk the same language” to accelerate app delivery

CA APM at NAB - From Development to Operations

• CA APM enables Dev and ops to “talk the same

language”, accelerating app delivery and Org

transformation

• Transaction response reduced from 20sec to 3sec

Enable DevOps Transformation

85% Decrease in Transaction Time

• Ability to trace transactions across our current

mainframe & new core baking platforms

Transaction Tracing & Mainframe

• Using same tools in Dev and Production help us

significantly reduce resolution time

Reduce Resolution Time

CUSTOMER FOCUSIMMINENT FUTURE FOR NAB IS…

• Modernization dictates new org adjustments

• DevOps model is deeply embedded in the culture

• User centric model will drive business owner participation

• Mobile is cornerstone of

our business, not only

customer (2+ M AMO

today) facing but also

internal

• Creating new & modern

App and Mobile

infrastructure (Oracle)

• Expanding to Mobile APM

and DevOps (native, hybrid,

web)

• Focus on pre-emptive

management

• App behavioral analytics

Imminent Future UBANK – 100% User Centric, 100% DevOps

Technology Organization

End Users are at the center of DevOps cycle

Time for new banking experience!

DEVdesign

develop

test

deliver

measure

report monitorOPS

Pre-DevOps

design

test

monitor

report

assess

develop deliver

measure

DEVOPS

Post-DevOps

DevOps TransformationChanging People, Processes, and Culture

Gartner Market Trends: ARA, DevOPs and Mobile Device Management Ignite Configuration Management, Laurie F. Wurster, Ronni Colville,

November 27, 2014.

CA DevOps Marketecture

Application Delivery

Infrastructure Management

Application Performance Management

DevOps

=> [developers]:/collaborate/APM operations =>

<= /accelerate /(new applications).delivery <=

“DevOps represents a change in IT culture as a trade-off for rapid IT service

delivery through the adoption of agile and lean practices in the context of a

systems-oriented approach.” – Gartner* (2014)

*Source : Gartner Market Trends: ARA, DevOPs and Mobile Device Management Ignite Configuration Management, Laurie F. Wurster, Ronni Colville, November 27, 2014.

CA DevOps: Application DeliveryAchieving Speed and Quality

Developer

Developer

Developer

DEV

DEV

DEV

TESTING

TESTING

Integration UAT/Staging Performance Production Operations

Continuous ValidationCA Application Test/CA Cloud Test/

CA Test Data Management

Continuous DeliveryCA Release Automation/CA Cloud Manager

Agile DevelopmentCA Service Virtualization

CA APM

On

-Pre

mis

e

APPLICATION ROOT CAUSE ANALYSISDiagnostics/Root-Cause Analysis/Transaction Tracing/Triage

APPLICATION BEHAVIOR ANALYTICSIT Operation Analytics Multi-Metric Correlation

END-USER EXPERIENCEApp Performance Over the Network and Servers

SaaS

CLOUD MONITORSynthetic Transactions

CA DevOps :Application Performance ManagementInspire Users With Every App Interaction

Partners

3rd Party and

Extensions

Business

Viewpoint

Infrastructure

Aware APMMainframe

Aware APM

CA DevOps tools: Infrastructure Management

Improve service quality, predictability and efficiency with Unified IM

Foundation for Successful DevOps

Unified Infrastructure Management

Unified Management Portal(Available via mobile)

Operational Intelligence Solutions(e.g., Capacity Management, Service Operations Management, etc.)

Systems Storage Network Database Apps Cloud SaaS DCIM Other

Industry-leading and easiest-to-use domain solutions

Adaptable and extendable (over 140 probes in CA Nimsoft Monitor today)

CA ApplicationPerformance Management

CA CloudService Management

Other CA andThird-Party Tools

1Strong IT Performance is competitive

advantage

2 DevOps practices improve IT performance

3 Organizational culture matters

4Job satisfaction is #1 predictor of Org

performance

RelationshipsOrganizational Performance->IT Performance -> DevOps*

* 2014 State of DevOps Report, presented by Puppet Labs

Questions?