p3_networktesting_2012

7/29/2019 P3_NetworkTesting_2012

1/4

InternationalService Benchmarks

DrivetestsOPtiMizAtiONMeasurements

SmartphoneCusomer

Experience

Mobile

Broadband

Performance

UnattendedProbing

NetworkCertifcation

Public

Benchmarks

Worldwide End-to-End Service

Quality Measurements

Network Measurement

& Testing


2/4

P3 communications is the leading provider of worldwide End-to-End user focused service measurements in conjunction with

delverng managemen level cusomed reporng. We operae an exensve ee of measuremen vehcles and porable

measuremen sysems for operaon n overseas markes o offer hgh exbly and a worldwde fooprn o our cusomers.

At P3 communications, our highly experienced project managers ensure that your benchmarking project is delivered as a

turnkey service: in time, in budget and with exactly the added value and analysis capabilities that both your engineering/

optimization as well as your medium and top-level management are looking for.This way, P3 communications is not only delivering towards your need for measurement data and analysis but also towards your

need for support in your internal and external communication.

Service Description:

The main objective of the benchmark

is getting a clear and independent

look on network performance from

the customers point of view. The

benchmark is a representative snap

shot of the End-to-End quality,

highlighting major differences between

compeors (or regons or vendors).

Basically, there are two different main

focuses for benchmark measurements:

Technical Performance

Benchmarking:

The focus of this kind of benchmark

is the technical capability of mobile

radio networks to support and carry

services like voice, web, YouTube

video, File transfer etc. Key properties

of the network here are coverage,

signal quality, capacity, available

technology (2G, 2.5G, UMTS, HSxPA,

LtE) and performance (e.g. hroughpu,

laency). ths knd of benchmarkng

is done by scanner measurements

as well as service tests. One main

objective of the technical network

performance benchmarking is to

get a picture of the whole network.

Customer Experience Benchmarking:

In contrast to the technical benchmark

an End-to-End service benchmark is

executed to observe the performance

of a mobile radio network from

a customers point of view, i.e.

commonly used services are measured

the applications and equipment the

end customer uses. Furthermore, for

data services the particular devices

and connection manager SW sold to

he end cusomers have a sgncan

nuence on he perceved servce

performance and form an integral part

of the P3 communications measurement

methodology.

International Benchmarking

Network Testing Activity Record / Reference Projects

Many projecs wh focus on nework esng, roll-ou vercaon and nework

benchmarking. Long term network / service assurance monitoring & alarming.

Benchmark experence n more hen 50 Counres (EMEA, APAC regons and

beyond).

International operator group benchmarks covering up to 20 countries in EMEA

and APAC.

Regular publc benchmarks n cooperaon wh Connec Magane (coverng

Connec-Counres Germany, Ausra, Swerland and Serba).

P3 communicationsdrive test facts in 2011

18 circumnavigations of the world,

720.000 measurement kilometers

104 projects in 30 countries world-

wide

3.000 days of measurement,

20.000 measurement hours


3/4

Todays market for mobile data services is driven by the progressing convergence

of telephony and mobile computing and networking in integrated portable devices

lke able PCs or smarphones.

Smarphones conrbue sgncanly o he ransferred daa volume and play an

important role concerning mobile data usage. The usage of smartphones differs

from laptop usage concerning mobility as well as transferred content and trafc mix.P3 communcaons favored measuremen approach reecs he specc

requirements that smartphones and the respective applications pose towards

cellular radio networks. Services such as mobile web browsing, cloud services,

usage of social networks and other web-based services as well as online mobile

media consumption demand among others ubiquitous availability, responsiveness

and a reliable base connectivity.

Our cercaon servce provdes a unque bene o you as a cered operaor: i enables your markeng o communcae your

networks strengths to your customer base by means of an independent assessment and 1. support print and online Marketing

campaigns, 2. support roll-out of new devices and services and 3. support technology upgrades and successful optimisation

acves (see hp://www.p3-cercaes.com).

the cercaon also eases nernal communcaon of your echncal marke poson n erms of servce avalably, negry,

coverage to senior management and stakeholders.

In brief, our 2012 test methodology and

best practice approach comprises the

following: 1. on-device usage oriented

End-to-End service quality testing for

smartphone data, 2. network capability

testing for smartphone data generally

focusing on base connectivity and res-

ponsiveness. In order to get a complete

view of the network and services quali-

ty one should also consider smartphone

voice in a multi-RAB environment, i.e.

CS voce wh smulaneous background

daa rafc.

Usage Oriented Services:

App download from reference server

(HttP), Download from lve servce

(HttP) Upload o reference server

(HttP), Upload o lve servce (HttP),

Web browsng (popular lve pages), e.g.

CNN, NYtmes, Google, GMX, Face-

book), Youtube lve vdeo download and

playout.

Smartphone data tests are done using

state-of-the-art Android against dedica-

ted reference servers and live servers

with changing content.

Network Oriented Measurements:

Fxed duraon download (HttP),

Fxed duraon upload (HttP), Laency

measurements. These tests focus on

the maximum capabilities offered by

a nework o tCP based applcaons.

Pre-dened (xed) ransfer duraons

wh pre-dened pauses are used

to spread tests in time domain and

geography.

Service Description

Over recent years P3 communications has

earned a high reputation in the Europeanmobile telecommunications market.

P3 communications is internationally

accepted for its crossbench and

respectable work for many reputable

network operators. Based on this

assurance, P3 communications already

performed and published independent

measurements, for example for the

well-known CONNECt-magane and also

ess and veres he qualy of servces

n order o ssue a cercaon. thusP3 communications enjoys industry-

wide trust as an independent expert.

On that behalf, P3 communications is

acng as an acknowledged cercaon

authority and P3 communications

cercaes are wdely used n publc

relations and both internal and externalcommunication.

Smartphone Customer Experience and Network Capability Testing

Network Certifcation

Certifcation Process

the goal s he ndependen aud, vercaon and cercaon of clens

statements about the quality of their telecommunication network or services.

1. Frs sep: he cusomer choses from a se of cerable saemens whch are

xed n a cercaon conrac beween P3 communcaons and cusomer.

2. + 3. P3 communications uses an accepted methodology suited to test the

intended statements and independently plans and executes the campaign.

4. P3 communications performs a statistical analysis of the results to verify the

saemens. in case of a successful vercaon of he saemens s docu-mened by a cercae, whch s publshed by P3 communcaons afer

clients authorization.

5. the clen can sar o use he cercae accordng o he conracs

regulations.


4/4

Operators seeking a high QoS are concerned about both customer experience and network performance, which cannot be

covered by regular information from network counters. To assure service quality permanent End-to-End measurements from a

customers point of view outside the network are needed.

For years, customers worldwide have been relying on SAM as P3 communications unattended monitoring framework for

stationary 2G/3G KPI and SLA measurements, including live overviews, alarming & trace access. 2012 will see the harmonization

of service measurement capabilities in the drive testing and monitoring areas of P3 communications inhouse tool chain basedon the latest generation of the known peeqBox Hardware, the powerful but unobtrusive peeqBox nano.

SAM is a full edged End-to-End

monitoring framework meeting these

requirements. Operators get live

network overviews at a glance. Its

online result presentations and network

traces allow in-depth engineering. These

overviews and an integrated alarming

ensure a fast response to network

problems. SAMs autonomous probes

measure multiple services and upload

their data to a central server which

handles result presentation via a web

portal. Data upload is either done over

the air or by a xed LAN connection.

Popular examples of attractive use

cases enabled by the SAM solution

are 1. Long term service and network

monitoring to support operational and

engineering tasks, 2. Performance

comparison between different regions/

vendors/operators/settings or before

and after soft- and hardware changes,

3. Detection of system failures (e.g. per

RNC/BSC area or MSC/SGSN area) and

4. Detection of overload situations in the

network (e.g. with Mean User Data Rate,

etc.).

The unattended probing solution

offers the following benets from the

operators perspective: 1. Out of the

box End-to-End measurements from the

customers point of view with probes

that can freely be positioned and do not

need any on-site attendance. 2. 24/7

measurements with no integration into

the operators infrastructure. 3. Slim but

powerful and intuitive online platform

for measurement conguration and

result access no complicated training

needed (expert in 15 minutes), web-

based without additional client license

cost.

The system is offered as a turnkey

solution provided as a managed service

customer gets results and does not

have to operate the probes, test

servers, backend systems, web servers

etc. As a result, we offer very short

lead/deployment times compared to

the in-house deployment of rented or

purchased solutions.

SAM Concept:

Unattended measurement units

Permanent KPI and SLA monitoring

(CS, PS and Messagng Servces)

Cusomer approach wh no

integration into the operators

infrastructure

Online (browser) access to measure-ment resuls and conguraon

Easy & intuitive web interface

Unattended Long-Term Probing

P3 communications GmbHDennewartstr. 25-27

52068 Aachen / Germanyphone +49 241 9437 400

[email protected]

Reference projects:

Long term End-to-End monitoring

of most relevant customer services

Monitoring of end user experience

during new vendor roll-out

Performance validation of

network optimization

p3_networktesting_2012

Documents