Introduction to

Real User Measurement

© 2013 SOASTA. All rights reserved. 2

Agenda

Introduction to RUM

Why RUM First

Demo of mPulse

Questions & Answers - input via Chat

Hosts:

Chris Addis & Oliver Hunt

© 2013 SOASTA. All rights reserved. 3

Speed is a means to an end,

not the ultimate goal

Happy

Customers

Spend &

Stay

Around

© 2013 SOASTA. All rights reserved. 5

Unhappy Customers Leave YouFrustrated customers = lost business

Boun

ce

Rate

Load Time

*Bounce Rate Defined: http://en.wikipedia.org/wiki/Bounce_rate

o Study for a cross section of

sites

o 8 Million pages

o 1.5 Million Visits

o 50 different dimensions

• Browsers

• Geographies

• Bandwidth Classifications

© 2013 SOASTA. All rights reserved. 6

Unhappy Customers Don’t BuyA case study from the world’s largest retailer

o 2011 – Walmart presents

findings from a RUM study

done to show the impact of

site performance on

revenue

o Results are staggering

• 1s improvement = 2%

conversion lift

• 100ms improvement = 1%

increase in incremental

revenueSource: SF WebPerf Meetup - http://minus.com/msM8y8nyh#2e

© 2013 SOASTA. All rights reserved. 7

Unhappy Customers Damage your Brand

© 2013 SOASTA. All rights reserved. 8

So if we want happy customers, everything we

do should put the user first,

© 2013 SOASTA. All rights reserved. 9

Which means our performance measurement

should focus on measuring users

© 2013 SOASTA. All rights reserved.

How fast am

I?

How fast should I

be?

How do I get

there?

© 2013 SOASTA. All rights reserved.

How fast am

I?

How fast should I

be?

How do I get

there?

http://www.flickr.com/photos/usnavy/

How do you

measure a

user?

© 2013 SOASTA. All rights reserved. 13

Users are different in many waysDifferent locations, browsers, pages & devices

© 2013 SOASTA. All rights reserved. 14

But all users use computers

&/or mobile devices

© 2013 SOASTA. All rights reserved. 15

So put something inside the computer

But not these computers

http://www.flickr.com/photos/luc/

http://www.flickr.com/photos/luc/

These computers

© 2013 SOASTA. All rights reserved.

How Fast Am I?

Instrument Every Interaction On Your Web Site

Copy Paste View

Results

© 2013 SOASTA. All rights reserved.

How fast am

I?

How fast should I

be?

How do I get

there?

© 2013 SOASTA. All rights reserved. 20

Start with the behaviors you care aboutMeasure them using RUM

Bounce

RateConversio

n

Revenu

e

Likes, Shares,

EtcComment

s

Items

Sold

Signup

s

© 2013 SOASTA. All rights reserved. 21

Then plot how speed changes the metricsExample: Bounce rate vs. page load time

© 2013 SOASTA. All rights reserved. 22

Choose a metric value to targetExample: 30% Bounce Rate

© 2013 SOASTA. All rights reserved. 23

Derive the required speed from the chartExample: 3.5 second load time for a 30% or better bounce rate

3.5 sec

© 2013 SOASTA. All rights reserved. 24

Understand what is need to reach goalsTo get a bounce rate of 15% the load time needs to be 2 sec

2 sec

© 2013 SOASTA. All rights reserved.

How fast am

I?

How fast should I

be?

How do I get

there?

© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 26

Find variations to focus on

o Geographic variations

o Browser variations

o Bandwidth variations

o Page variations

o Time variations

o Day variations

© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 27

Page variations

© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 28

Browser variations

© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 29

Geographic variations

© 2013 SOASTA. All rights reserved.© 2013 SOASTA. All rights reserved. 30

mPulse supports all of these

© 2013 SOASTA. All rights reserved.

mPulse

Collect

everything

Map to business

objectives

View real

user data in

real time

Real Time, Real User Intelligence

SOASTA mPulse

SOASTA mPulse

www.soasta.com/mpulse