fight back against isp scorecards

Fight Back Against ISP Scorecards

ProceraVP of Global Marketing

Cam Cullen

Anyone Seen This Before?

Interesting…But not Actionable

What about this one?

OTT Providers are Winning the PR WAR on Performance

HoweverSpeed Quality

FCC Network Neutrality “With respect to network performance, we adopt the following enhancements:

- The existing transparency rule requires disclosure of actual network performance. In adopting that requirement, the Commission mentioned speed and latency as two key measures. Today we include packet loss as a necessary part of the network performance disclosure.

- We expect that disclosures to consumers of actual network performance data should be reasonably related to the performance the consumer would likely experience in the geographic area in which the consumer is purchasing service.

- We also expect that network performance will be measured in terms of average performance over a reasonable period of time and during times of peak usage.

Source: page 73-74 of FCC-15-24A1, Emphasis Added

Exploring Subscriber Experience Metrics

Take The Subscriber’s Perspective

Throughput/Bandwidth/Speed

Application Type Throughput NeedsWeb Needs short bursts of download performanceVideo Sustained throughput delivers good qualitySocial Media Needs short bursts of download/upload performanceGaming Most games do not require high bandwidthUpload Sustained bursts of upload performance Download Sustained bursts of download performanceVoice Low throughput requirements

Latency

Application Type Throughput NeedsWeb High latency leads to slow page load timesVideo Not usually a concern except for initial loading of videoSocial Media High latency can slow interactive sharing experienceGaming High latency leads to lag in real-time gamesUpload N/ADownload N/AVoice High latency leads to poor voice experience

Packet Loss

Application Type Throughput NeedsWeb Packet Loss can lead to slow page load times.Video Less sensitive to loss unless it affects throughputSocial Media Packet Loss can slow interactive sharing experience Gaming Packet Loss leads to lag in real-time gamesUpload N/ADownload N/AVoice Some loss can be tolerated, high loss leads to perceived

latency

Collecting SX Metrics• Sampling

– Does not provide consistent data for entire footprint• Active Probes

– Can affect the actual performance of network, especially during peak hours

• All subscriber traffic, all the time– Meets FCC guidance:

• Actual customer experience• Over reasonable period of time• During Peak Usage

Measuring All Traffic, All the Time Enables an MSO to create

their own ScoreCard

Putting it All TogetherApplication Type Throughput Latency Loss

Web Needs short bursts of download performance

High latency leads to slow page load times

Packet Loss can lead to slow page load times.

Video Sustained throughput delivers good quality

Not usually a concern except for initial loading of video

Less sensitive to loss unless it affects throughput

Social Media Needs short bursts of download/upload performance

High latency can slow interactive sharing experience

Packet Loss can slow interactive sharing experience

Gaming Most games do not require high bandwidth

High latency leads to lag in real-time games

Packet Loss leads to lag in real-time games

Upload Sustained bursts of upload performance

N/A N/A

Download Sustained bursts of download performance

N/A N/A

Voice Low throughput requirements

High latency leads to poor voice experience

Some loss can be tolerated, high loss leads to perceived latency

“Grading” Performance

Score ThroughputA Awesome experienceB Almost perfect, but some slight impairments noticedC Good experience but noticeable impairmentsD Usable with frustrating impairmentsE Really poorF Unusable

Network Experience Scoring

ScoreCard Uses• Reporting to regulators on network performance

with actual subscriber metrics• Marketing to subscribers

– Targeted service offerings “Good for Gaming!” – High Value SLA-based offerings– Scoring Service Plans by performance “An A for Video”– Touting network capabilities

• Improving the network where deficiencies occur

cam.cullen@proceranetworks.com Cam Cullen