vodafone group benchmark in italy - p3...

VODAFONE GROUP BENCHMARK IN ITALY

2

P3 COMMUNICATIONS GMBHAM KRAFTVERSORGUNGSTURM 3, D-52070 AACHEN, GERMANY

tested and measured the performance of voice and data services on smartphones in comparison to other LTE/UMTS/GSM mobile radio networks in metropolitan and rural areas of Italy.

The audit was done as a performance benchmark performed by P3 communications between February 28th 2018 and March 23th 2018 in cities and towns as well as on connection roads.

Measurements have been executed as drive tests out-doors using a Samsung Galaxy S8 cat9 Smartphone 300 Mbit/s Download / 50 Mbit/s Upload.

All data measurements have been performed in 4G preferred mode. Voice measurements have been done in 4G/4G preferred mode on both sides, and in VoLTE- VoLTE preferred mode on both sides,while call origin has been alternated.

The following pages provide a comparative over-view about the performance results observed for the different tested service types.

3

MEASUREMENT OVERVIEWMEASUREMENT SETUP

Drivetest Voice Data

Device Sony Xperia XZ cat9 Samsung Galaxy S7 cat9

Samsung Galaxy S8 cat9Samsung Galaxy S7 cat9

Test Cases

Mobile-to-Mobile (M2M)Side1 (4G preferred) to Side2 (4G preferred)

Side1 (VoLTE) to Side2 (VoLTE)115 sec call window70 sec call duration

15 sec call setup timeoutMulti-RAB traffic injection on both sides

Data 4G preferred CAHTTP DL datastream 7sHTTP UL datastream 7s

HTTP 3MB DL fixed file transferHTTP 1MB UL fixed file transfer

Web Browsing - Kepler ETSI Ref. Page10 Live web pages (50% http / 50% https)

4 YouTube HD video ~ 45s

Mobility andRoute Types

Drive test53 % in Cities, 14% in Towns and 33% on Roads

Cities, towns and roads

Samples ~ 7570 per Operator ~ 2590 per Operator

Dates 21 measurement days28.02.2018. – 23.03.2018.

4

Rome

Bologna

Florence

VeronaMilanoTorino

Genova

NapoliBari

Messina

Catania

Palermo

Enna

CefaluTaormina

Angri Eboli

Caserta

Frosinone

CerignolaMassafra

Cosenza

Chiaravalle

Lonato del Garda

Faenza

Fano

Fiano Romano

Orvieto

Civitanova MarcheSan Benede�o del Tronto

San SeveroTermoli

Taranto

Pescara

Alessandria

Rapallo

Viareggio

As

Chivasso

Dalmine

TESTING ROUTE

5030 kmmeasuring distance

18 %of population measured

CitiesTownsRoads

5Audit was managed in close cooperation with VF Group

CLAIMS

BEST IN TESTVodafone

BEST IN VOICEVodafone

BEST IN DATAVodafone

6

OVERALL SCOREVodafone achieved the highest score among competitors with 891 points out of maximum 1000.

TOTAL SCORE

Operator

Total Score1000 Points

Shown total scores are rounded

Vodafone

561

331

891

Operator 2

540

262

802

Operator 3

427

229

656

Operator 4

356

227

582

VOICEmax. 400

DATAmax. 600


Shown voice scores are rounded

Towns Drivetest

Roads Drivetest

Ci�es Drivetest

Operator

76%

61%

39%

Operator 2

88%78%

71%

Vodafone

64%54%

40%

Operator 3

65%53%

36%

Operator 4

VOICE SCOREThe following graphic indicates the achieved values of all networks for the geographical categories “Cities”, “Towns” and “Roads” in voice services.

7

DATA SCOREThe following graphic indicates the achieved values of all networks for the geographical categories “Cities”, “Towns” and “Roads” in data services.


Shown data scores are rounded

Towns Drivetest

Roads Drivetest

Ci�es Drivetest

Operator

94% 89%80%

Operator 2

96% 91% 88%

Vodafone

74%67% 66%

Operator 3

62%52%

59%

Operator 4

VOICE AND DATA OVERALLThe following table indicates the score points achieved by the networks under test in the modules “Voice” and “Data Services” as well as the breakdown of achieved points in the geographical categories “Cities”, “Towns” and “Roads”.

Vodafone Operator 2 Operator 3 Operator 4

Voice max.400 331 262 229 227

Cities Drivetest 240 88% 76% 64% 65%

Towns Drivetest 80 78% 61% 54% 53%

Roads Drivetest 80 71% 39% 40% 36%

Data max. 600 561 540 427 356

Cities Drivetest 360 96% 94% 74% 62%

Towns Drivetest 120 91% 89% 67% 52%

Roads Drivetest 120 88% 80% 66% 59%

Total 1009 891 802 656 582

Shown scores are rounded.

8

The following table indicates the achieved percentage of the maximum score in each of the different data services.

Data Service Group max. Vodafone Operator 2 Operator 3 Operator 4

Cities

Web Browsing 108,0 97% 97% 76% 64%

File Download 90,0 92% 88% 71% 64%

File Upload 90,0 96% 93% 72% 68%

YouTube 72,0 99% 97% 77% 48%

Towns

Web Browsing 36,0 93% 94% 65% 50%

File Download 30,0 88% 81% 65% 53%

File Upload 30,0 89% 87% 68% 65%

YouTube 24,0 96% 96% 72% 36%

Roads

Web Browsing 36,0 89% 83% 61% 52%

File Download 30,0 90% 81% 68% 62%

File Upload 30,0 87% 77% 66% 63%

YouTube 24,0 86% 78% 74% 58%

Voice Service Group Unit Vodafone Operator 2 Operator 3 Operator 4

Cities

Qualifier [%] 99,0 97,0 96,5 96,6

Call Setup Time [s] 4,6 5,0 7,1 7,0

AVG Speech Quality [MOS-LQO] 3,9 3,8 3,2 3,2

Towns

Qualifier [%] 97,1 94,4 94,6 94,3



Roads

Qualifier [%] 93,8 85,2 87,9 86,7



VOICE KPI OVERVIEWThe following table indicates the achieved values of all networks under test in each of the relevant Voice Key Performance Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”.

9

DATA KPI OVERVIEWThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical categorie “Cities”.

Data Cities KPI Name Unit Vodafone Operator 2 Operator 3 Operator 4

HTTP Live Page DL

Qualifier [%] 99,7 99,7 98,1 96,3

Time to first Byte [ms] 360 352 561 429

KBytes first second [KB] 498 539 375 400

HTTP Static Page DLQualifier [%] 99,8 99,7 98,4 92,0

AVG Session Time [s] 1,2 1,3 2,5 2,6

HTTP file DL 3MB

Qualifier [%] 99,8 99,9 99,0 98,4


90% faster than [kbit/s] 19287 11480 3547 1975


HTTP file UL 1MB

Qualifier [%] 99,8 99,8 98,9 98,3


90% faster than [kbit/s] 9.093 7.287 2.379 2.375


HTTP DL FDTT 7s

Qualifier [%] 99,9 99,9 98,2 96,6

AVG throughput [kbit/s] 66992 53683 29253 29983



HTTP UL FDTT 7s

Qualifier [%] 99,4 98,5 96,7 95,9

AVG throughput [kbit/s] 26.422 26.329 15.407 14.378



YouTube

Qualifier [%] 99,9 99,4 96,1 91,0

Start Time [s] 1,8 1,8 2,8 2,5

Playouts w/o interruptions [%] 99,9 99,9 98,7 96,2

AVG Resolution [p] 1077,5 1077,5 1053,7 1037,2

10

DATA KPI OVERVIEWThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical categorie “Towns”.

Data Towns KPI Name Unit Vodafone Operator 2 Operator 3 Operator 4

HTTP Live Page DL

Qualifier [%] 99,3 99,6 96,5 95,1





HTTP file DL 3MB

Qualifier [%] 100,0 98,8 98,1 96,5




HTTP file UL 1MB

Qualifier [%] 99,5 99,5 99,0 98,6




HTTP DL FDTT 7s

Qualifier [%] 99,5 99,8 97,0 94,9




HTTP UL FDTT 7s

Qualifier [%] 99,0 98,8 96,0 95,4




YouTube

Qualifier [%] 99,5 99,3 94,9 88,4

Start Time [s] 1,9 2,0 2,8 2,9


AVG Resolution [p] 1.076,7 1.068,6 1.060,7 1.021,8

11Audit was managed in close cooperation with VF Group

DATA KPI OVERVIEWThe following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geographical categorie “Roads”.

Data Roads KPI Name Unit Vodafone Operator 2 Operator 3 Operator 4

HTTP Live Page DL

Qualifier [%] 98,2 96,5 94,1 92,0





HTTP file DL 3MB

Qualifier [%] 99,3 97,9 95,3 95,0




HTTP file UL 1MB

Qualifier [%] 98,5 97,0 96,0 94,8




HTTP DL FDTT 7s

Qualifier [%] 98,5 96,3 94,0 93,2




HTTP UL FDTT 7s

Qualifier [%] 98,0 94,5 92,8 92,4




YouTube

Qualifier [%] 96,1 93,2 92,2 87,4

Start Time [s] 2,2 2,2 3,2 3,0


AVG Resolution [p] 1.070,1 1.059,6 1.060,9 1.048,4

P3 communications GmbHHakan Ekmen, [email protected], +49 151 571 33 235

Maziar Kianzad, [email protected], +49 151 571 33 362

Am Kraftversorgungsturm 3 │ 52070 Aachen │ Germany │ +49 241 9437 400www.p3-group.com │ [email protected]

vodafone group benchmark in italy - p3...

Documents