a lecture series by octoscope 24-may-2016 to maintain isochronous nature of voice packet streams by...
TRANSCRIPT
www.octoscope.com
Types of Wireless Tests
Performance
Behavior
System
AP / Router
Client
Sensor / Mesh node
MCS = modulation coding scheme
Throughput
Packet Error Rate (PER)
Jitter
Roaming
Data rate / MCS Adaptation
Automatic Channel Selection
Channel Width Adaptation
Dynamic Frequency Selection (DFS)
Interoperability
Coexistence
Mesh Self-forming / Self-healing
Forwarding rate
Association capacity
Receiver performance
www.octoscope.com
Wireless Test Standards
2G/3G/LTE Wi-Fi Data transport Applications
3GPP RAN5 →ETSI
→PTCRB/GCF
(conformance,
interoperability)
CTIA (TIS/TRP
MIMO-OTA
SAR)
Wi-Fi Alliance (WMM,
WPA, etc.)
IEEE 802.11.2 (range,
throughput, latency)
IETF RFC 2285, 2544,
2889 (packet loss,
latency, jitter)
ITU-T Voice Quality
P.800 (MOS); P.862
(PESQ); G.107 (R-
Factor)
IETF video quality
RFC 4445 (MDI MLR,
DF)
3GPP = 3rd generation partnership project
RAN = radio access network
IETF = internet engineering task force
RFC = request for comments
GCF = global certification forum
ITU = international telecommunication union
ETSI = European Telecommunications Standards Institute
CTIA = cellular telecommunications internet association
TIS = total isotropic sensitivity
TRP = total radiated power
MIMO = multiple input multiple output
OTA = over the air
SAR = specific absorption ratio
WMM = wireless multimedia
WPA = wireless protected access
NIST = national institute of standard and technology
SEP = smart energy profile
MOS = mean opinion score
PESQ = perceptual speech quality measure
R-Factor = rating factor
MDI = Media Delivery Index
MLR = media loss rate
DF = delay factor
www.octoscope.com
Voice over Wi-Fi Considerations
• Important to maintain isochronous nature of
voice packet streams by controlling delay,
jitter and packet loss
• Bursty packet loss due to
Roaming
Interference from LTE-U or LTE-LAA
• Power consumption – sleep modes
APSD (automatic power save delivery)
PSMP (power save multi-poll) protocol
• WFA WMM (wireless multi-media)
prioritization protocol
www.octoscope.com
IEEE 802.11.2 Performance Test Specification
Defines test methods and metrics for evaluating performance of 802.11 devices and systems
www.octoscope.comwww.octoscope.com
CONFIDENTIAL
www.octoscope.com
CONFIDENTIAL
www.octoscope.com
CONFIDENTIAL
Example 802.11.2 Metrics
• Throughput: overall
• Throughput vs. range
• Throughput vs. attenuation (conducted and OTA)
• Throughput vs. receive power
• Transmit rate adaptation
• Antenna diversity
• Adjacent channel interference
• BSS transition time
• Fast BSS transition time
• Receiver sensitivity in a conducted environment
• Unicast intra-BSS throughput
• Unicast ESS throughput
• Multicast forwarding rate
• Endstation association rate
• Endstation database capacity
• Power consumption
• Coexistence of overlapping BSSs in an OTA
environment
• Packet loss
• Latency
• Jitter
• Video performance
www.octoscope.com
Throughput
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
www.octoscope.com
Forwarding Rate
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
Forwarding rate
www.octoscope.com
Packet Error Rate
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
…
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
Packet Error Rate
www.octoscope.com
Packet Error Rate / Packet Loss Rate
• Packet loss, especially bursty packet loss, causes poor signal quality
• Delay and jitter (variation in delay) can also cause loss of quality
• 200 ms events (signal loss or delay) are audible to the ear
• In 802.11 networks, bursty packet loss can be due to
Congestion in the infrastructure
Client roaming from one AP to another
Interference from LTE-U or LTE-LAA
~100 microsecondpackets, depending on CODEC
~20-30 millisecond gaps
www.octoscope.com
Jitter
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
…
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
Jitter
www.octoscope.com
Data Rate Adaptation
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
…
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
Data rate adaptation
www.octoscope.com
Association Capacity
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
Association capacity
www.octoscope.com
Receiver Performance
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
…
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)Receiver performance
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
Packet Error Rate
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
Packet Error Rate
Jitter
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
Packet Error Rate
Jitter
Data rate adaptation
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
Packet Error Rate
Jitter
Data rate adaptation
Association capacity
www.octoscope.com
Comprehensive Test Suite
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
Packet Error Rate
Jitter
Data rate adaptation
Association capacity
Receiver performance
www.octoscope.com
Need for Automation of Controlled RF Environment
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
Throughput
…
MIMO-OTA
MU-MIMO
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Channel frequency
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Motion
Data rate / Modulation Coding Scheme (MCS)
MIMO = multiple input multiple output
MU-MIMO = multi-user MIMO
Forwarding rate
Packet Error Rate
Jitter
Data rate adaptation
Association capacity
Receiver performance
Exponential number of tests vs. variables
www.octoscope.com
Traffic Analysis InterferenceSTA AP Rotation Path lossOrientation Motion
Windows
Linux
OS/X
Android
Traffic
Endpoint
Need for Controlled RF Environment
www.octoscope.com
Environment
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Partner device (802.11a/b/g/n/ac)
Number of partner devices
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
Environment
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Partner device
Number of partner devices
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
Each Throughput Test Run = 1 Point on The Excel Plot
Throughput test run – typically 1 minute or longer
Typical run can have thousands of points. For example,
5 degree rotation * 1 dB attenuation = 4,320 points
www.octoscope.com
Throughput vs. Range Plot
28
0
50
100
150
200
250
300
350
400
0 10 20 30 40 50 60
Th
rou
gh
pu
t (M
bp
s)
Attenuation Setting (dB)
TCP Throughput
Each point on the plot may be averaged over
time (e.g. 1 minute) for statistically valid result.
Each point can also simultaneously be
averaged vs. DUT orientation with respect to
test antennas. Averaging = repeatability.
www.octoscope.com
octoBox Industry Benchmark Test Platform
29
http://www.smallnetbuilder.com/wireless/wireless-reviews/32823-google-tp-link-onhub-router-reviewed?showall=&start=2
www.octoscope.com
SmallNetBuilder.com Benchmark Testing
30
Source: http://www.smallnetbuilder.com/images/stories/wireless/how_to_test_wireless/2-4ghz_mpe_test_points.jpg
A more complete picture of performance using
programmable attenuators vs. several points in a
house.
www.octoscope.com
Beamforming Gains
31
Both positions showing at least a 5dB gain with beamforming
www.octoscope.com
Environment
Multipath Emulator
(MPE)
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Partner device
Number of partner devices
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
MPE Broadband Frequency Response
DC 6 GHz
Wide-open frequency response
No limit to operating channel width
20/40/80/160 MHz channel support
octoScope’s multi path emulator (MPE) frequency response
www.octoscope.com
octoBox-MPE vs. IEEE Model B
34
Model B 0ns 10 ns 20ns 30ns 40ns 50ns 60ns 70ns 80ns
Cluster 1 0 -5.4 -10.8 -16.2 -21.7
Cluster 2 -3.2 -6.3 -9.4 -12.5 -15.6 -18.7 -21.8
Time domain response obtained from measured frequency domain
www.octoscope.com
Environment
Adjacent Channel Interference
Co-Channel Interference
Bluetooth
Baby monitor
ZigBee
Radar
…
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Partner device
Number of partner devices
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
iGen Browser Based GUI – Traffic Interference
36
WMM = wireless multi media
MCS = modulation coding scheme
2.4, 5 GHz Wi-Fi traffic generator
Radar, OOK waveform generatorTX port
www.octoscope.com
iGen Browser Based GUI – Waveform Interference
37
CSV = comma separated variable
FHSS = frequency hopping spread spectrum
OOK = on off keying
OOK waveforms between 500 MHz and 6 GHz
User definable waveforms downloadable as CSV files
2.4, 5 GHz Wi-Fi traffic generator
Radar, OOK waveform generatorTX port
www.octoscope.com
Environment
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Partner device
Number of partner devices
Network load
Channel Frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
Channel
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Partner device
Number of partner devices
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
octoBox testbed frequency range
700 MHz to 6 GHz
www.octoscope.com
Client Testing
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
AP type (802.11a/b/g/n/ac)
Number of APs
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
AP Testing
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Client type (802.11a/b/g/n/ac)
Number of clients
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
Adaptation
Range
Orientation
Channel width (20/40/80/160 MHz)
Multipath
Motion
Interference
Client type (802.11a/b/g/n/ac)
Number of clients
Network load
Channel frequency
Data rate / Modulation Coding Scheme (MCS)
www.octoscope.com
Examples of Wireless Adaptation Techniques
MIMO mode
Data rate or MCS
Roaming
Channel frequency
Channel width
Band steering
www.octoscope.com
45
Device API
Testbed API
REST + WebSockets
Java TCL Python
node.js
JavaScript C/C++
Applications
Traffic AP InterferenceSTA Analysis Rotation Path loss LicensingDevice
DiscoveryOrientation Motion
Windows
Linux
OS/X
Android
Traffic
Endpoint
octoScope Test Automation Applications and API
Throughput Roaming 3rd partyDashboardPacket
loss rateJitter
MCS
adaptation
Channel
adaptation
API = application programming interface
www.octoscope.com
Roaming Script
Controls motion,
velocity, pinging,
graphical reporting
www.octoscope.com
Support for MU-MIMO and Beamforming
802.11 MU-MIMO beamforming
techniques enable stations to
transmit simultaneously in the
same airlink and on the same
channel frequency. MU-MIMO = multi user multiple input multiple output
www.octoscope.com
MU-MIMO Gains
52
PATENT PENDING
Run # MU-MIMO
OFF
(Mbps)
MU-MIMO
ON
(Mbps)
1 360 935
2 355 935
3 358 934
4 361 938
5 357 946
6 357 946
Over 2.6x gain
www.octoscope.com
iperf session 1
iperf session 2
iperf session 3
1G Ethernet
MU-MIMO ON
700 Mbps
MU-MIMO OFF
311 Mbps
Changing AP
settings
2.3x MU-MIMO gain
MU-MIMO
Beamforming in the
octoBox Testbed
53
www.octoscope.com
1x1 MU-MIMO STA
1:4
1:4
1:4
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1x1 MU-MIMO STA
54
MU-MIMO with Controllable Correlation
1:4
PATENT PENDING
1x1 MU-MIMO STA
1x1 MU-MIMO STA
www.octoscope.com
1x1 MU-MIMO STA
1:4
1:4
1:4
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1:2
1x1 MU-MIMO STA 1:2
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1:2 1x1 MU-MIMO STA
55
MU-MIMO with Controllable Correlation
1x1 MU-MIMO STA
1x1 MU-MIMO STA
1x1 MU-MIMO STA 1:2
1:4
PATENT PENDING
www.octoscope.com
Configurable for a Wide Variety of Tests
quadSplitter
quadAtten
quadAtten
iGen
octoBox
Png PC
AP1
Console
Ethernet Filter
4
AP2
Station
Under
Test
Linux PC
quad
Atte
n
quad
Spl
itter
quad
Atte
n4
4
iGen
Optional
iGen
iGen
triSack-26
www.octoscope.com
Support for Coexistence Testing
Controlled cross-
coupling between
cells
Clients
AP
UEs
eNB
www.octoscope.com
Example Mesh Test Configuration
58
Control attenuators to force auto-re-
routing of traffic flow to test self-healing
1
Nodes are in octoBox
isolation chambers
www.octoscope.com
Complete Isolation Through Careful Filtering and Sealing
Dual gig
Ethernet
PoE
Dual USBGig
Ethernet
& USB
HDMI
Waveguide
for fiber
connections
AC power filter
Filtered vents
Fan
switch
www.octoscope.com
Easy to Integrate with a Variety of InstrumentsCellular Network Simulators (LTE, LTE-A, LTE-U, 2G, 3G)
MD8475A Cellular UESignaling Tester
LTE – Up to 2CC CA, up to 2x2 MIMO,
GSM/WCDMA/TDSCDMA/CDMA/EVDO
Spectrum Analyzers
MT8821C 6GHz Cellular UE RF Tester
LTE – Up to 5CC CA, LTE-U, up to 4x4 MIMO,
GSM/WCDMA/TDSCDMA/CDMA/EVDO
MS2830A Spec An3.6GHz/6GHz/13.5GHz/26.5GHz/43GHz/90GHz
VSA Options forWiFi/DSRC/BT/Cellular
Up to 125MHz Analysis Bandwidth
MT8820C 3.8GHz Cellular UE RF Tester
LTE/WCDMA/GSM/TDSCDMA/CDMA/EVDO
NEW NEW
MD8475B 6GHz Cellular UE Signaling Tester
LTE – Up to 4CC CA, LTE-U, up to 2x2 MIMO (4x4 MIMO in Future),GSM/WCDMA/TDSCDMA/CDMA/EVDO
MS2690A 6GHz Spec AnMS2691A 13.5GHzMS2692A 26.5GHz
VSA Options forWiFi/DSRC/BT/Cellular
Up to 160MHz Analysis Bandwidth
MS2720T HandheldBattery Operated Spec An
9GHz/13GHz/20GHz/32GHz/43GHz
MS27101A 6GHz Indoor Remote Access
Spectrum AnalyzerAccess Via the web
From anywhere
MS27102A 6GHz Outdoor Remote Access
Spectrum AnalyzerAccess Via the web
From anywhere
Power Meters
ML2437A/38APower Meter
ML2495A/96APulse
Power Meter
ML2487AWideband Peak
Power Meter
MA24XXXAUSB Power Sensors
(9 models)
NEW NEW
www.anritsu.com
Anritsu has been doing RF
for over 100 years
www.octoscope.com
Flexible Device Arrangement
Plastic hardware,
brackets and shelving
maintain controlled
anechoic environment
