Test Report PCM-i7 Rogers LTE Lab December 2011

Overall Management Summary - PCM-i7 Performance Tests

-> No issues found

- PCM-i7 USB Tests

-> No issues found

- MCM Hookup Performance Tests

-> No issues found

-> Data measurement at 60Mbit/s didnt show any degradation if there is a voice measurement running (POLQA)

- PCM CD vs. PCM-i7 Comparison

-> On PCM CD:

- Up to 30 Mbit/s, we are on the safe side

- Between 30 and 40 Mbit/s possible IP Trace packet loss

- Above 40 Mbit/s we have an impact on the throughput

-> On PCM-i7:

- No issues found

- Lab Tests Sierra Wireless AirPrime MC7700

-> No issues found

-> Avg. throughput as expected ~60Mbit/s

- Lab Tests Novatel Expedite E371

-> Throughput limited at 43Mbit/s (even with latest FW/HW)

- Live Tests Huawei E398u-15

-> No issues found

-> ~65 Mbit/s

Results located here:

\\10.23.1.174\media\Measurement Files\Rogers Canada\2011\2011_12_16 LTE Tests PCM-i7\

and here:

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\

PCM-i7 Performance Tests

PCM-i7 performs as expected at 60Mbit/s

MC7700 in Hookup - NO Phone - MCM FDDI Channels Disabled

- Thats basically our reference at the moment since we cannot use the internal embedded module slot due to the

known issue with Sierra Wireless and the TI xHCI USB 3.0 controller.

- The throughputs are as expected and correlate pretty much with the speedtest results (which reflects peak

throughputs)

- CPU load around 35%

- \\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime

MC7700\Hookup - NO Phone - MCM FDDI Disabled

MC7700 in Hookup Nokia C7 running POLQA in parallel

- The throughputs are as expected, no significant influence

- CPU load still around 35%

- \\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime

MC7700\Hookup - Nokia C7 - POLQA

Remarks:

Were using a beta version of the 64bit IP Tracer which runs in a dedicated process. This seems to have a very good influence on

the CPU load. The IPTracer generates only around %10 CPU load. That is unexpected low. Plus, we havent seen *any* missing

packets from Netmon.

PCM-i7 USB Tests All major combinations have been tested using Philips Capacity Test Tool. No significant influence has been seen.

Please refer to the screen shots in the respective folders:

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\USB Tests\

MCM Hookup Performance Tests

NO Phone - MCM FDDI Disabled

Nokia C7 - POLQA

Example files:

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\Sierra Wireless AirPrime MC7700\

PCM CD vs. PCM-i7 Comparison

Focused on the PCM CD (with SSD) and the question if Rogers will see degradation in their measurements at the throughputs

they currently have.

1:1 Comparison PCM CD vs. PCM-i7 using Rogers current Job

- Since we still couldnt answer Rocks question if the data they collect today is valid, we captured a measurement file

with their current job one the PCM CD and on the PCM-i7. The results are in line with our statement, we provided to

AT&T this summer.

- Up until 30 Mbit/s, we are on the safe side.

- Between 30 and 40 Mbit/s we are in a gray zone, but do not expect a big impact (except some dropped IP Packets in

the IP Trace)

- Above 40 Mbit/s we have an impact on the throughputs

- For sure, we have to carefully discuss the results, but from what we can see now in the comparison, we have to be

aware of the limitations

- The throughputs below are from their 50MB HTTP download. Capacity would be even worse

The above graph shows pretty well, that we have to expect degradation above ~50Mbit/s. The conditions in the lab are very

stable and you can see on the left side that using the Capacity test, we properly fill the pipe in UL at around 25Mbit/s. In DL

however, when we expect a steady line at around 55Mbit/s, we have a lot of up and downs around 50Mbit/s. To the right, we

can see the same DL Capacity test without Diversity (mainly IPTracer) running.

If we add a POLQA voice test in parallel, it gets a bit worse.

All tests have been performed with Tom/Philips new external IP Tracer. So there is not a lot we currently have in our pockets ;-)

Example files:

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\Comparison

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-CD\Sierra Wireless AirCard 313U

Lab Tests Sierra Wireless AirPrime MC7700 Throughputs are consistent and at an expected level around 58Mbit/s avg.

Direction

Tota

l N

um

ber

of Test

s

Data

Sess

ion C

om

ple

ted R

ate

Avg T

hro

ughput

[kbps]

Min

Thro

ughput

[kbps]

Max T

hro

ughput

[kbps]

Avg D

ura

tion [

s]

Min

Dura

tion [

s]

Max D

ura

tion [

s]

Tota

l byte

s tr

ansf

err

ed [

kByte

]

Uplink 7 100.0% 22435.77 17966.09 23812.97 29.96 29.94 29.97 588120.1

Downlink 7 100.0% 58009.71 55054.84 59383.79 59.96 59.93 59.98 3043414.2

Example files:

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\MC7700 - Nokia C7 - Nokia 6720 II\

Lab Tests Novatel Expedite E371 Even after getting the latest version of the module (just received on Thursday 15

th from Rhonda Bass

[RBass@dcsbusiness.com]), the Novatel Expedite shows the same limitations on the PCM-i7 as seen before.

The throughput is limited at around 45Mbit/s:

Looking at the network performance monitor, we can see an unsteady peak:

In comparison, here an example of the MC7700 at around 60Mbit/s

Example files:

\\10.23.1.174\media\Measurement Files\Lab\2011-12-12_LTE_at_Rogers_CM-i7\PCM-i7\USB Tests\E371 PCIe Slot - MCM

disconnected\

Live Tests Huawei E398u-15 Rogers provided us with special SIM cards to perform some first tests in their new 2600MHz (20MHz bandwidth) network. They

told us that they still have some issues and are expecting around 60Mbit/s. On a drive test weve got an average throughput of

59Mbit/s. They plan to go nationwide in June 2012.

Example files:

\\10.23.1.174\media\Measurement Files\Rogers Canada\2011\2011_12_16 LTE Tests PCM-i7\2011_12_11\Huawei E398u-15

LTE Only RAW LOG\