filtering noisy 802.11 time-of-flight ranging...

7

Click here to load reader

Upload: phungnga

Post on 12-Apr-2018

219 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

Filtering Noisy 802.11 Time-of-Flight RangingMeasurements

Andreas MarcalettiETH Zurich

Zurich, Switzerland

Maurizio ReaETH Zurich

Zurich, Switzerland

Domenico GiustinianoIMDEA Networks Institute

Madrid, Spain

Vincent LendersArmasuisse

Thun, Switzerland

Aymen FakhreddineIMDEA Networks Institute &

UC3MMadrid, Spain

ABSTRACTTime-of-Flight (ToF) echo techniques have been proposedas a way to estimate the range between regular Wi-Fi sta-tions. Recent works either did not address practical ques-tions for deployability, or made evaluations in basic setups,or used advanced 802.11 hardware designs. We build an ap-proach solely deployed using ToF measurements and relyingon software access point (AP) upgrades of simple commer-cial off-the-shelf 802.11 chipsets. Our solution filters noisymeasurements collected by WiFi chipsets of six dollars each,it has been tested across different and heterogeneous setupsand testbeds, and has the potential to enable ToF rangingin every Wi-Fi chipsets.

Categories and Subject DescriptorsC.2.1 [Computer-Communication Networks]: NetworkArchitecture and Design—Wireless Communication

KeywordsIndoor Localization; 802.11; Time of Flight; Design; Imple-mentation; Evaluation

1. INTRODUCTIONIn the attempt to find an alternative to error-prone signal-

strength based ranging measurements [3,5,10,13,16], Time-of-Flight (ToF) echo techniques have recently received atten-tion by the research community. The underlying principle ofToF is that the distance between two devices is estimated us-ing the time that the signal travels between two devices, withthe advantage of being much less susceptible to the diversityof the obstacles between the devices [8, 14]. The intuitionis that electromagnetic waves travel at a speed that is closeto the speed of light for most propagation media in typicalindoor environments, and thus the signal propagation speedis fairly independent on the environment, obstacles, etc.

Permission to make digital or hard copies of all or part of this work for personal orclassroom use is granted without fee provided that copies are not made or distributedfor profit or commercial advantage and that copies bear this notice and the full cita-tion on the first page. Copyrights for components of this work owned by others thanACM must be honored. Abstracting with credit is permitted. To copy otherwise, or re-publish, to post on servers or to redistribute to lists, requires prior specific permissionand/or a fee. Request permissions from [email protected]’14, December 2–5, 2014, Sydney, Australia.Copyright 2014 ACM 978-1-4503-3279-8/14/12 ...$15.00.http://dx.doi.org/10.1145/2674005.2674998.

Despite of these advantages, ToF measurements are verysensitive to noise since, at the speed of light, a measurementerror of 1 µs already results in a distance estimation error of300 meters. This noise is further exacerbated when usingCommercial Off-The-Shelf (COTS) WiFi devices for a cost-effective and wide-spread implementation. Recent effortscould increase the accuracy of ToF at the cost of leveragingadvanced hardware designs available in more recent WiFichipsets [14]. However, most of the Access Points (APs) inthe world are still deployed with older hardware, and it iseconomically not possible to change all the APs with newerhardware in the near future (and also not appealing in termsof electronic garbage).

We leverage the existing 802.11 protocol timing specifica-tion (and nothing more than that) to build a system thatruns on COTS APs to estimate the distance to target sta-tions. We rely on a customized firmware operating in thecore of the 802.11 MAC state machine of a low-cost Wi-Fi chipset (cost per unit of less than six dollars). To dealwith the intrinsic challenges of noisy ToF measurements, wedevelop an adaptive filter which manages to predict the dis-tance despite the large noise introduced by the devices andthe multipath reflections in indoor environments.

Our approach has been tested across various setups andtestbeds. We show that our filtering technique needs just afew samples to estimate the distance range with a medianerror of 1.7 − 2.4m and a 80-percentile error of 3.7 − 5.8m,comparable to [14] (median error of ≈ 1m and 80-percentileerror of ≈ 5m) that required advanced inputs from the hard-ware such as channel state information per antenna. Oursolution further outperforms recent works such as [8].

Given its simplicity, the principles discussed in our workcan be applied to any old and new 802.11 AP already de-ployed, just with software upgrades.

2. BACKGROUND AND CHALLENGESThis section describes the basics of WiFi ToF ranging and

highlights various real-world challenges that arise when ap-plying this technique with simple off-the-shelf devices.

2.1 WiFi ToF Ranging TechniqueWhile traditional ToF-based echo techniques as employed

in radar systems rely on uncoded RF signals and their re-flections, WiFi echo techniques use regular frames of com-munication. In WiFi communication, every DATA frame isacknowledged by the receiver with an ACK frame. Since

Page 2: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

DATA

DATA ACK

DATA

ACKTarget Station

ACKToF Measuring

Station

tp tp tACK

d δT

tMEAS(d)

Figure 1: Principle of the Wi-Fi ToF echo technique.In the example, δT offset is originated at the tar-get device, and it depends on the hardware delay toschedule the ACK at the target device. Not shownin the figure, time offset may be also generated atthe measuring device.

the interframe time between the DATA and ACK frames isfixed by the 802.11 standard (the Short InterFrame Symbol,SIFS, time), the delay between DATA and ACK frames canbe used to infer the distance between two nodes. However,ToF-based ranging estimation is affected by severe noise andhas thus long been considered impracticable for WLAN lo-calization. Back then, [12] suggested that the accuracy ofspacing between a DATA and ACK frame that are definedto be separated by a SIFS time is up to 2 µs, equal to 600mof error, and too high for indoor localization. However, thetechnique was studied in [6, 9, 11, 15] (subjected to variablejitter and very high dispersion), and later refined in [7,8,14]showing that better accuracy is achievable than the wort-case bound dictated by the maximum SIFS tolerance.

ToF ranging can be formulated as follows. If d is thedistance between a local station and a target, the measuredtime-of-flight tMEAS(d) between a sent DATA frame and areceived ACK frame is expressed as

tMEAS(d) = 2 ⋅ tP(d) + tACK + δ, (1)

where tP(d) is the signal propagation time between the trans-mitter of the DATA frame and the target (channel reci-procity is assumed), tACK is the time needed to transmit theACK, δ is an offset depending on the target and local sender.The distance to the target device is then inferred as

dn = c2⋅ (tMEAS(d) − tACK − δ), (2)

where c is the speed of signal propagation which is closeto the speed of light in air. Assuming that N consecutivesamples {dn} are collected, the distance between the localstation and the mobile device is finally estimated as:

d = f (dn), (3)

where f is either the expected value on the input data orany other estimator.

Firmware integration. To alleviate any unnecessarysource of noise or instability, the time measurements tMEAS(d)have to work as close as possible to the radio hardware. Thebest location to fully control the measurement is thereforein the firmware of the WiFi radio chipset, rather than inthe driver as proposed in [8]. To measure tMEAS(d) in thefirmware, we have customized the open-source 802.11 open-FWWF firmware1. This firmware is written in assembler1http://www.ing.unibs.it/openfwwf/

Firmware user space

send ToF

(UDP socket)

retrieve ToFstore ToF

SHM

b43 wireless

driver

Figure 2: ToF measurement architecture. The fig-ure shows the interaction between firmware, driverand user space. Measured data from the firmwareis transferred to the driver through shared memory.Buffered ToF measurements are then sent to userspace.

and runs on off-the-shelf 802.11 Broadcom chipsets, suchas the ones widely used in Linksys APs. Our customizedfirmware reports tMEAS(d) for each successful transmissionof an 802.11 DATA frame. The timing is regulated by thegeneral purpose timer, running on the wireless card’s inter-nal clock at a rate of 88MHz. The timer starts to countclock cycles just after the 802.11 processor sets up a registerto indicate that a frame has been sent. Once the ACK framehas been received (or the ACK timeout has elapsed), anotherregister is updated and the timer gets stopped. Every timea measurement is made, the firmware writes tMEAS(d) into adefined address of the shared memory (SHM). The measure-ment architecture is shown in Fig. 2. Since the driver hasalso access to the shared memory block, it can retrieve themeasurement every time an ACK is received2. In the driver,we gather additional data about the incoming ACK such asthe data rate, MAC addresses, etc, and store them all ina buffer. Once this buffer is full or a timeout elapsed, thedata is transferred to the user space with the help of UDPsockets.

2.2 Real-world ChallengesIn the real-world, ToF measurements are affected by large

noise coming from the timing imprecision of off-the-shelfWiFi devices. The offset δ is given by:

δ = δT + δL , (4)

where δT and δL are the offsets of target station and localsender, respectively. In addition, the multipath signal prop-agation characteristics of complex indoor environments playan important role to ToF measurements. In the following,we describe the main sources of noise and how they affectthe accuracy of ToF ranging.

Target and measuring noise. The 802.11 standardspecifies the SIFS time between the reception of a DATA andthe transmission of an ACK at the receiver as a fixed inter-val. In 802.11b, for example, this time is specified as 10 µs [2].However a relatively high tolerance of 1 µs is tolerated whichcan result in significant noise and distance estimation er-rors up to 300 meters if the target would fully exploit thisspecified tolerance level. While most chipsets may not fullyexploit this tolerance, the dispersion is still quite significant.To illustrate this, Fig. 3 on the left represents the result-ing dispersion of a typical Broadcom WiFi chipset as targetdevice. The shown histogram was obtained by estimatingthe distance dn according to Eq. (2) for 10000 packets. To

2We operate in promiscuous mode which allows us to knowin the driver when an ACK has been received and thus anew data is available in the SHM.

Page 3: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

0 20 40 600

0.02

0.04

0.06

0.08

0.1

0.12

LOS propagation

Distance [m]

0 20 40 600

0.02

0.04

0.06

0.08

0.1

0.12

Distance [m]

NLOS propagation

0 20 40 600

0.02

0.04

0.06

0.08

0.1

0.12

Cable

Distance [m]

Figure 3: Noise introduced by ToF ranging. Testswith controlled environment (Cable) show that thethere are sources of large dispersion in the estima-tion. Tests over the air (LOS and NLOS propaga-tion) show that the distribution greatly depends onthe channel conditions. All the tests are in addi-tion subject to quantization noise and other spuriousnoise sources.

avoid any dispersion from environmental effects, the mea-surements were performed over a coaxial cable of 13.5 meterslength. As we can see, there is heavy noise in the measure-ment setup that leads to distance estimations ranging from0 to 25 meters.Environmental noise. It is well known that signal prop-agation in complex indoor environments is subject to mul-tipath effects in which multiple copies of the transmittedsignal arrive at the receiver over different reflected paths.It is even possible that the direct component is entirely at-tenuated and the signal is received only over indirect paths.Since signals that travel over indirect paths will take longerto arrive at the receiver, they introduce an error in the dis-tance estimation when considering the time-of-flight. Thissituation is shown in Fig. 3 in the middle and on the rightwhere the same experiment as on the left was repeated butfor a line-of-sight (LOS) and non-line-of-sight (NLOS) sig-nal propagation link over omnidirectional antennas. Thedispersion spans a range of 40 and 60 meters for the LOSand NLOS links respectively. In addition, the NLOS linkshows a skewed distribution, suggesting that the signals arereceived from different propagation paths over the durationof the experiment. Multipath effects must therefore be takeninto consideration in order not to overestimate the distancewhen dealing with reflected signal propagation paths. Fi-nally, multipath may also happen in LOS links, and thus amethod robust to the propagation conditions must be de-signed.Additional sources of noise. Off-the-shelf WiFi chipsetshave not been designed to provide accurate ToF measure-ments. Additional noise therefore comes from the coarseclock resolution of the radios. For example, the Broadcomchipset operates with a reference clock of 88MHz, corre-sponding to a maximal distance resolution of 1.7 meters. Inaddition to this quantization noise, off-the-shelf chipsets in-troduce all sorts of considerable additional noise. As wecould see in the histograms of Fig. 3, the shape of the distri-bution is far from being smooth despite using 10000 samplesto create the histograms, suggesting that the radios musthave some bias when measuring the time. The measurement

27850 27900 27950 27850 27900 27950 27850 27900 27950 278509.8

10

10.2

10.4

10.6

δ T[µ

s]

tMEAS

(d) [µs]

15 m

60 m

1 m

Figure 4: QQ plots for LOS links. The plots showthat the error of the local offset has a negligible im-pact on the noise of tMEAS(d).

noise must therefore also be factored in to estimate the dis-tance.

3. TARGET AND MEASURING NOISETo dissect the relative importance of the noise of the tar-

get station with respect to the local noise, we use a widebandoscilloscope (Infiniium 90000A Oscilloscope) with a fast sam-pling rate of 10GS/s to measure the target offset δT . A hornantenna is connected to the oscilloscope which serves as apassband filter for the 2.4GHz band. The target device isin close proximity to the horn antenna, so that radio sig-nals of received 802.11 DATA and transmitted 802.11 ACKare immediately captured by the oscilloscope, and effectsof signal reflections are minimized. The noise of our high-end oscilloscope can be regarded as low such that reportedmeasurements are not affected by any measuring noise butdominated by the target noise [4].

We use above setup to statistically compare the effec-tive ToF to the measured time tMEAS(d) as being locallyreported by our firmware on the Broadcom chipset. To com-pare both distributions, we use the method of the quantile-quantile (QQ) plot. We collect samples in LOS settings atd = {1, 15, 60}m. Results are summarized in Fig. 4. We ob-serve a linear pattern, which indicates that the noise of thetarget station and the data measured locally by the 802.11firmware have very similar distributions. Hence, the disper-sion of the local offset has a negligible impact on the noiseof tMEAS(d), and most of the dispersion comes from the tar-get device. This further demonstrates that our approach toimplement the ToF measurement in the firmware allows tominimize the impact of the local dispersion of the noise forLOS links with limited multipath. In the next section, welook at the impact of richer multipath.

4. ENVIRONMENTAL NOISEEnvironmental noise is tricky to deal with. The reasons

are the following:

● multipath reflections introduce a skewness of the sam-ple distribution which cannot be easily smoothed outby averaging over a set of biased samples,

● the target noise introduces large offset noise which addsto the noise created by multipath,

● environmental noise is highly unpredictable as the re-flected paths are location-specific.

Page 4: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

We therefore need an adaptive filter that is calibratedto the actual multipath characteristics of the experiencedlocation-specific environment.

Our goal is to design a filter that takes a series of Nconsecutive measurements {d1 , d2 , . . . , dN}, and selects the

p-percentile d(p) of the series that minimizes the estima-tion error. Intuitively, in absence of multipath, the medianp = 50 could fairly represents the distance, while taking themedian in presence of multipath reflections will cause anover-estimation of the distance due to the added traveleddistance of the signals. By selecting a percentile p < 50 toestimate the distance, we can therefore counterbalance thosebiased values in the estimation process.

4.1 Data IntegrityFirst, to guarantee data integrity in our evaluation, we

removed sequences of samples which experienced undesiredside effects for a systematic evaluation. In particular, forstatistical relevance of the results, consecutive ToF measure-ments are supposed to be independent and identically dis-tributed (i.i.d.). While this assumption holds in most tests,this condition does not hold in general. We perform cabletests and they show that the autocorrelation is very low forlag greater than zero. We observe however that there arelinks with high autocorrelation when DATA is transmittedover the air. This could be explained with the presence ofmore than one path between transmitter and receiver, whichmay imply that the circuitry continuously jumps betweentwo states in an attempt to tune the frame synchronization.We therefore discard those sequences which were subject toa high absolute lag-one autocorrelation (above 0.2) for theanalysis. Removing measurements with a high autocorrela-tion is a valid assumption in the real-world as this kind oftest can easily be performed by the AP.

4.2 Estimating Multipath NoiseThe second step is to estimate the noise caused by multi-

path reflections on a link. Since we cannot directly measurethe individual multipath components at the signal-level onoff-the-shelf WiFi radios, we propose to use a higher-levelestimator f for this. We explored various options in an ex-tensive evaluation in one of our testbeds (Testbed I, Fig. 7)with all links with low lag-one autocorrelation (83% of thelinks). As estimators, we considered the first three moments(median, standard deviation, and skewness) for the ToF aswell as for the Received Signal Strength Indicator (RSSI).For each of these six estimators, we evaluate two variants,leading to a total of twelve candidate estimators. In thefirst variant, we determine the moments directly on the rawsamples. In the second variant, we attempt to pre-filter obvi-ous outliers that arise from the device-related measurementnoise prior determining the moments. These outliers arefiltered out applying the Thompson Tau technique, a statis-tical method for deciding whether to keep or discard samplesbased on the expected value and the expected deviation ofthe sequence of samples.

We evaluate the precision of these estimators by determin-ing their correlation to the optimal percentile popt , defined asthe percentile that provides the minimum absolute distanceestimation error as:

popt = argmin0≤p≤0.5

∣d − d(p)∣ (5)

unfiltered pre-filtered

median of RSSI 0.62 0.63standard deviation of RSSI 0.04 0.05

skewness of RSSI 0.23 0.24median of ToF 0.76 0.76

standard deviation of ToF 0.19 0.21skewness of ToF 0.20 0.51

Table 1: Absolute value of Pearson correlation coef-ficient between different moments of the RSSI andToF versus the optimal percentile popt (0=no corre-lation, 1=maximal correlation).

that is, the a-posteriori optimal percentile for each link giventhe true distance of each link in our experiments.

To quantify the correlation between the different momentsand popt , we use the Pearson correlation coefficient on the en-tire set of links of Testbed I. The Pearson correlation coeffi-cient is an indicator of the linear correlation of the variables,where absolute values close to zero indicate a low correlationand absolute values close to one represent a high linear de-pendence of two variables. A value close to one thus indicatesthat a moment is a good estimator to predict a percentilethat will filter out the multipath noise effectively.

Table 1 shows the resulting correlation coefficient for alltwelve variants. The best correlation is provided by the me-dian of the ToF, followed by the median of the RSSI andthe skewness of the ToF. All other moments have a correla-tion coefficient below 0.5 which indicates a low correlation.Most of the moments profit from pre-filtering to remove theoutliers. In particular, the skewness of the ToF increasesfrom 0.20 to 0.51 and is therefore considerably better whenpre-filtering the outliers.

One may wonder why the skewness of the ToF has a worsecorrelation than the median ToF. Intuitively, the skewness ofthe distribution should be a good indicator of the multipath,given that links with strong reflected (delayed) componentsare left-skewed, with popt smaller than for right-skewed link.Our results suggest that the combined device-related noise ofthe receiver and the measuring station have a strong negativeeffect on the correlation on the skewness. This is reflectedin the pre-filtered version of the skewness which has a con-siderably better correlation than the unfiltered version. Incontrast, the median of the ToF is much more robust to thisdevice-related noise and therefore outperforms the skewness.In addition, it reflects the tendency of having more links af-fected by multipath for longer distances.

4.3 Filter DesignMotivated by the good correlation of the median ToF and

the optimal percentile, we designed a filter that relies on thiscorrelation to select an appropriate percentile of the sampleToF measurements when estimating the distance. The filterrelies on a linear model which is derived from the empiricaldistribution of the median ToF versus popt . We call it offlinecalibration, since it would be usually performed before actualtests. This distribution on all the 207 links of Testbed I isshown in the top of Fig. 5. We note that the value of theoptimal percentile is widely distributed between 0 ≤ popt ≤50%. Therefore, it does not exist one value of percentile

Page 5: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

0 5 10 15 20 25 30 35 40 45 500

10

20

30

40

Optimal Percentile popt

[%]

Med

ian

of T

oF

[clo

ckcy

cles

] Offline Calibration

0 5 10 15 20 25 30 35 40 45 500

10

20

30

40

Optimal Percentile popt

[%]

Med

ian

of T

oF

[clo

ck c

ycle

s] Online Calibration

Figure 5: Median ToF versus optimal percentile poptfor all links of Testbed I - Offline and online calibra-tion.

Multipath Estimator

Multipath-matched

Filter

Median

{d1, d2,…, dN}

d

p

d(p)

_

^ ^ ^ ^

Figure 6: Adaptive filter design.

p that it is optimal, but it rather changes from link to link.We therefore perform a linear regression on these data pointsand obtain the linear link-dependent model, as representedby the continuous line in the figure. Since the correlationcoefficient of the median ToF versus the optimal percentileis not improved by pre-filtering outliers, we apply this modelon the raw, unfiltered samples. (For the estimator based onthe skewness of ToF we instead use the pre-filtered version).

Since it is desirable to avoid offline calibration, we then runthe same methodology measuring the median ToF betweenpairs of APs, which can be performed online (as long as thedistance between APs is known a priori). The results areshown in the bottom of Fig. 5. We find that the calibrationresults in a very similar linear regression.

We illustrate our filter design in Fig. 6. In practice, ourfilter works as follows. For a given series of N consecutivemeasurements {d1 , d2 , . . . , dN}, we first determine the medianToF, d. The median ToF is then used to estimate the amountof multipath using a linear model. The output of the estima-tor is the percentile value p. We apply linear interpolation

to the sequence of measurements {d1 , d2 , . . . , dN} and select

the p-percentile d(p) of the series that minimizes the error.

5. EVALUATION METHODOLOGYThis section presents the system and environmental setup

we used to evaluate the performance of our filter.

5.1 System SetupAP infrastructure. We have build a prototype ToF

system to evaluate its performance in real-world conditions.Our system is based on COTS APs from Soekris (net5501

Figure 7: Testbed I. Circles correspond to AP loca-tions and crosses to target locations.

embedded machine with a 500MHz AMD Geode LX singlechip processor). The APs are equipped with Broadcom Air-Force54G 4318 mini PCI type III cards which we operatewith our customized firmware and b43 driver presented inSection 2.1. As operating system on the APs we use Ubuntuserver 10.04 with a Linux kernel version 2.6.32.60. In or-der to operate the embedded device as WLAN AP, we usethe software suite hostapd. The APs are connected to thecentral localization unit over Gigabit Ethernet.

Target devices. As target devices we use Dell Inspiron5150 laptops equipped with Broadcom AirForce54G 4318mini PCI type III cards. The operating system on the lap-tops is Ubuntu 10.04 with its original Linux kernel version2.6.32-21.32. The wireless cards are operated in client mode.

5.2 Deployment ScenariosTestbed deployment. We perform experiments in three

indoor testbeds deployed in different environments. We de-ploy 10 APs in Testbed I and III and 9 APs in Testbed II.Testbed I and Testbed II are office environments. The en-vironment of Testbed I is shown in Fig. 7 and it covers asurface of almost 1000m2. We use 25 randomly selected lo-cations (marked with a cross) to test our algorithms. Weconducted tests over two different days, with some positionrepeated again with different location of some furniture, andcollected a total of 207 wireless links. Testbed II features 180links and it covers a smaller space of around 200m2. The tar-get station is in 20 different positions. Testbed III has beendeployed at the facilities of the IEEE/ACM IPSN MicrosoftIndoor Localization Competition [1]. The testbed features200 links and it covers 320m2. The target device is placed at20 different positions across two rooms and a hallway.

In all the testbeds there exists a mixture of line-of-sightand non-line-of-sight wireless links. The testbeds also con-tain several propagation obstructions, including concretewalls, tables and glasses. All experiments are conductedwith other active WLAN networks. We operate the threetestbeds on a fixed frequency channel of the 2.4 GHz ISMband. The PHY automatic selection rate is active, such thatthe measurements include probes sent at different rates.

6. EVALUATION RESULTSThis section evaluates the performance of different ranging

estimators in our testbeds.

6.1 Filter PerformanceDistance Ranging Accuracy. To test our filter, we

have evaluated its performance on all the links of TestbedI. For each link, we first compute the distance estimationerror with 20 samples, and then calculate the average error

Page 6: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

0 2 4 6 8 10 12 14 16 18 200

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

Distance Error [m]

EC

DF

Testbed I

Filter: Median of ToF (Online Calibration)Filter: Median of ToF (Offline Calibration)Filter: Median of RSSI (Offline Calibration)Filter: Skewness of ToF (Offline Calibration)Mean of ToFMedian of ToFCAESAR

Figure 8: ECDF of the distance estimation errorfor our adaptive filter compared to other schemes(Testbed I). For each scheme, we use sequences of 20samples.

0

1

2

3

4

5

6

7

Testbed IPearson−Correlation = 0.76

Testbed IIPearson−Correlation = 0.79

Testbed IIIPearson−Correlation = 0.89

Dis

tanc

e E

rror

[m]

Median of the Distance Error80−Percentile of the Distance Error

Figure 9: Performance in the three differenttestbeds.

using 500 sequences. We consider our filter that uses the me-dian ToF to estimate the optimal percentile, and two otherversions of the filter that rely on the median of the RSSI(pre-filtered) and the skewness of the ToF (pre-filtered), asthey provided the second- and third-best correlation coeffi-cients in Section 4.2. In addition, we also provide the errorfor naive approaches such as the mean and median of theToF (without any filter).

Figure 8 shows the Empirical Cumulative Distribution Func-tion (ECDF) of the distance ranging error. Our three newestimators clearly outperform the mean or the median. Themean and median have roughly equal estimation error. Theirmedian error is approximately 4.5m and the 80-percentile er-ror is approximately 11.8m. The error of the filter that usesthe median RSSI slightly outperforms the skewness of theToF. This is not surprising since Table 1 shows a highercorrelation coefficients of the filter with median RSSI. Thebest performance is achieved with our filter using the medianToF. In Testbed I, we obtain a median error of 2.4m and a80-percentile error of 5.3m.

Comparison with [8]. Fig. 8 also shows that our threeestimators outperform CAESAR, introduced in [8], whichachieves a median error of 4.3m and a 80-percentile error of7.4m. Our evaluation of CAESAR is also very consistent tothe one recently presented in the indoor evaluation of [14].

Online calibration. We then compare online versus of-fline environmental calibration for the filter of median of

100 101 1020

2

4

6

8

10

12Testbed I

Number of Samples

Dis

tanc

e E

rror

[m]

Median of the Distance Error80−Percentile of the Distance Error

Figure 10: Median and 80-percentile error of ourestimator that filters the noise based on the medianof ToF. Results are provided for different number ofsamples.

ToF (similar results are achieved with our other filters). Asreported in Fig. 8, the online calibration achieves similar re-sults with respect to the offline tests, with median error of2.6m and a 80-percentile error of 5.4m. Thus, the environ-mental calibration can be executed online without significantperformance loss.

Robustness to different environments/testbeds.Fig. 9 shows the median and 80-percentile of the distanceerror for the three different testbeds using sequences of 20samples. As shown in the x-label of the figure, we measurea high Pearson correlation coefficient between the median ofToF and the optimal percentile (0.76 − 0.89). The mediandistance error is in the range 1.7−2.4m and the 80-percentileerror is in the range 3.7− 5.8m. Concluding, the estimator isrobust across different environments.

Impact of Number of ToF Samples. A further pa-rameter we evaluate with regard to our filter is the numberof ToF measurement samples N that are used for the esti-mation of the distance. Figure 10 shows the error for ourfilter that relies on the median of the ToF as a function ofthe number of samples. It is remarkable that the error is sta-ble with five or more samples for the median of the distanceerror, and with ten or more samples for the 80-percentile ofthe distance error.

7. CONCLUSIONWe have designed a cost-effective ranging technique such

that it does not require any special hardware, special anten-nas, or software-defined radio architectures. Our solutioncan be deployed as a software upgrade to current WLANinfrastructures. While our best performing estimator maybe a bit counter-intuitive, we have shown its robust perfor-mance in a variety of different setups and testbeds. SinceToF-based WLAN localization is still at its infancy, we be-lieve that further research in this area might help to evenfurther improve the accuracy of our results in the future.

AcknowledgmentsWe are grateful to Francesco Gringoli for sharing the open-FWWF code and supporting the project with his enlight-ening comments. The work was supported by Armasuisse.The research leading to these results has received fundingfrom the European Research Council under the EU’s SeventhFramework Programme, ERC Grant Agreement no. 617721.

Page 7: Filtering Noisy 802.11 Time-of-Flight Ranging Measurementseprints.networks.imdea.org/905/1/con131s-marcalettiA.pdf · Filtering Noisy 802.11 Time-of-Flight Ranging Measurements Andreas

8. REFERENCES[1] Microsoft indoor localization competition,

http://research.microsoft.com/en-us/events/

ipsn2014indoorlocalizatinocompetition/.

[2] IEEE std 802.11-2012 (revision of IEEE std802.11-2007), IEEE standard for informationtechnology, 2012.

[3] Bahl, P., and Padmanabhan, V. RADAR: anin-building RF-based user location and trackingsystem. In Proc. IEEE INFOCOM’00 (Mar. 2000).

[4] Bourchas, T., Bednarek, M., Giustiniano, D.,and Lenders, V. Poster abstract: Practical limits ofwifi time-of-flight echo techniques. In Proceedings ofthe 13th International Symposium on InformationProcessing in Sensor Networks (Piscataway, NJ, USA,2014), IPSN ’14, IEEE Press, pp. 273–274.

[5] Chintalapudi, K., Padmanabha Iyer, A., andPadmanabhan, V. N. Indoor localization without thepain. In In Proc. of ACM MobiCom ’10 (2010),pp. 173–184.

[6] Ciurana, M., Barcelo-Arroyo, F., andIzquierdo, F. A ranging system with IEEE 802.11data frames. In Radio and Wireless Symposium, 2007IEEE (2007), pp. 133–136.

[7] Gallo, P., Garlisi, D., Giuliano, F., Gringoli,F., and Tinnirello, I. WMPS: A positioning systemfor localizing legacy 802.11 devices. In Transactions onSmart Processing and Computing, (October 2012).

[8] Giustiniano, D., and Mangold, S. CAESAR:carrier sense-based ranging in off-the-shelf 802.11wireless lan. CoNEXT ’11, ACM, p. 10.

[9] Golden, S. A., and Bateman, S. S. Sensormeasurements for Wi-Fi location with emphasis on

time-of-arrival ranging. IEEE Trans. Mobile Comput.6, 10 (Oct. 2007), 1185–1198.

[10] Goswami, A., Ortiz, L. E., and Das, S. R. Wigem:A learning-based approach for indoor localization.CoNEXT ’11, ACM, pp. 3:1–3:12.

[11] Gunther, A., and Hoene, C. Measuring round triptimes to determine the distance between wlan nodes.NETWORKING’05, Springer-Verlag, pp. 768–779.

[12] Li, X., Pahlavan, K., Latva-aho, M., andYlianttila, M. Comparison of indoor geolocationmethods in dsss and ofdm wireless lan systems. InIEEE Fall VTC 2000 (2000), vol. 6, pp. 3015–3020vol.6.

[13] Lim, H., Kung, L.-C., Hou, J., and Luo, H.Zero-configuration, robust indoor localization: Theoryand experimentation. In INFOCOM 2006. 25th IEEEInternational Conference on ComputerCommunications. Proceedings (April 2006), pp. 1–12.

[14] Mariakakis, A. T., Sen, S., Lee, J., and Kim,K.-H. Sail: Single access point-based indoorlocalization. In Proceedings of the 12th AnnualInternational Conference on Mobile Systems,Applications, and Services (New York, NY, USA,2014), MobiSys ’14, ACM, pp. 315–328.

[15] McCrady, D., Doyle, L., Forstrom, H.,Dempsey, T., and Martorana, M. Mobile rangingusing low-accuracy clocks. Microwave Theory andTechniques, IEEE Transactions on 48, 6 (2000),951–958.

[16] Youssef, M., and Agrawala, A. The horus wlanlocation determination system. MobiSys ’05, ACM,pp. 205–218.