Next Article in Journal
A Generic Multi-Layer Architecture Based on ROS-JADE Integration for Autonomous Transport Vehicles
Previous Article in Journal
Damping Force and Loading Position Dependence of Mass Sensitivity of Magnetoelastic Biosensors in Viscous Liquid
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

WallSense: Device-Free Indoor Localization Using Wall-Mounted UHF RFID Tags

School of Information Science and Engineering, Shandong University, Qingdao 266237, China
*
Authors to whom correspondence should be addressed.
Sensors 2019, 19(1), 68; https://doi.org/10.3390/s19010068
Submission received: 30 November 2018 / Revised: 21 December 2018 / Accepted: 21 December 2018 / Published: 25 December 2018
(This article belongs to the Section Sensor Networks)

Abstract

:
To achieve device-free indoor localization without the active participation of the users, this paper presents WallSense, a device-free indoor localization system based on off-the-shelf Radio RFID (Radio-Frequency Identification) equipment. The system deploys two orthogonal tag arrays in adjoining walls and uses the RSSI and phase information measured by RFID readers to localize the target. By differentiating the backscattered signal between adjacent tag pairs, WallSense is able to eliminate most undesirable factors and extract information directly related to the location of the target. By applying Particle Swarm Optimization (PSO) with a novel weighted fitness function and combining the localization result of two orthogonal tag arrays, the system is able to localize the target with high accuracy. Experiments show that the system is able to localize human target with 0.24 m median error. Also, WallSense has low deployment overhead and do not require the users to carry any devices.

1. Introduction

Currently a heated research topic, indoor localization has applications in health care [1,2], building automation [3], security [4], retail [5], entertainment [6], and assisted living [7,8]. The widely used outdoor positioning solution Global Positioning System (GPS) performs poorly indoors because the direct transmission path it requires is obstructed in indoor scenarios [9]. This gives rise to a series of research papers on indoor localization techniques and test methods [10].
Among those indoor localization approaches, device-free localization methods have more application potential as it doesn’t require users to carry any devices or tags [11]. Consider the scenario of elderly care, in which the location of the elderly has to be monitored. Using a device-based localization method would cause extra trouble to the elders as they have to remember to carry the device around. Some elders may have dementia and forget to carry the device. As a result, a device-free method would be highly desirable [12,13]. Video-based methods provide a good solution in public areas [14], but cannot be deployed in private room due to privacy issues [15,16,17]. RF-based device-free localization methods, however, do not require line-of-sight, preserves privacy, and do not have to be in direct contact with the users [11,12]. This makes it ideal in areas such as intruder detection [18], fitness tracking, elderly monitoring and law enforcement such as rescue missions [19].
However, current device-free localization methods either require costly customized hardware, or require a lot of site surveying, which is detrimental to the large-scale deployment of the system. In order to solve this problem, our goal is to build a device-free localization system that is low-cost, easy-to-deploy and have high scalability. In this paper, we present WallSense, a RFID-based device-free localization system built with Off-the-Shelf RFID readers and tags.
WallSense deploys arrays of passive RFID tags on adjoining walls as probes and measure the radio signal bouncing off the target. By deriving a propagation model and utilizing a technique that differentiates the signal between adjacent tags, WallSense is able to eliminate most undesirable factors and extract information directly related to the location of the target. A particle swarm optimization (PSO) algorithm is then applied to combine the location information provided by all the tag pairs using a weighted method and pinpoint the location of the target. To validate our propagation model and evaluate the positioning algorithm, we implemented WallSense using off-the-shelf Ultra High Frequency (UHF) RFID equipment and conducted a series of experiments. In our experiments, WallSense exhibited high accuracy and were robust against carrier frequency.
The rest of the article is organized as follows: Related works are introduced in Section 2. Technical background and the channel model applied is introduced in Section 3, and Section 4 gives a detailed account of the design of the localization system. The implementation and evaluation of the system are elaborated in Section 5 and Section 6 respectively. In the last section, a discussion concludes our work.

2. Related Works

Radio-frequency based indoor localization methods can be classified into two categories: device-based and device-free localization. Device-based localization systems require that the target carries an extra device that can communicate with other nodes [11]. The system locates the target by locating the device it carries. For example, pieces of baggage can be tracked by locating the RFID tags attached to them in an automatic sorting system [20,21] at airport terminals. Device-free methods, on the other hand, detects and locates the target by observing changes in the environment, without active participation on the targets’ side [22]. In 2007, the notion of device-free indoor localization was first defined by Moustafa Youssef et al. [11]. Since then, Device-free indoor localization methods have received much attention from researchers over the past decade. Among them, methods have been proposed based on radio frequency [12,19,23], optics [14,24], sound [25,26] and others like electrical field [27]. Over the years, researchers have proposed methods that realize RF-based device-free localization from many different approaches including radio grid, fingerprinting, RF backscatter and radar.
  • Methods based on radio-grid use multiple transceivers to form a radio grid and detecting the target by analyzing the attenuation between the links [28,29]. A training phase is often required to calibrate the parameters of the links. By combining with particle filters with RF tomographic imaging, researchers are able to track a time-varying group of (up to 4) persons with high accuracy [30,31]. On the other hand, however, these methods require densely distributed sensor nodes in small areas to get high accuracy, which lowers its application value.
  • Methods based on fingerprinting first construct a radio map with the target being at predetermined locations, then determine the location of the target by looking up the radio map [32,33]. TagTrack [34] deploys tags on the floor in a matrix and track human beings using K nearest neighbor (KNN) and Hidden Markov Model (HMM). Its average positioning accuracy is 0.7 m. Li et al. [23] proposed a scheme that boosts accuracy by improving Weighted-KNN (WKNN) algorithm. Through applying principal component analysis and successive cancellation, methods like SCPL are able to detect the number of subjects and simultaneously localize multiple subjects [31,35]. This approach provides reasonable localization accuracy with low hardware cost. However, constructing the radio map would require measuring the RSS values with the target being at a large number of predetermined locations, which is time-consuming and costly.
  • Methods based on RF backscatter observe the change in the environment by calculating the backscattered signal from reflective objects or passive tags [36,37]. This technique is common in RFID systems that use passive tags, in which tags attached to static objects in the area of interest serve as sensors. D-watch [38] used commodity RFID readers and tags to localize people in rich multipath environments by triangulating the directions that have the greatest power drops. The method has 16.5 cm median error. However, this method requires several antenna arrays to calculate the direction of incoming tag backscatter signals. Moreover, the method requires multiple Impinj GPIO adaptor and antenna hubs, which would introduce attenuation and limits the interrogation range of the system. Tadar [19] develops a high gain directional antenna and combines a multipath propagation model with HMM to realize through wall target tracking. Its median localization accuracy is 7.8 cm in the X dimension and 20 cm in the Y dimension. However, it involves using specifically designed hardware and requires calibration to remove the error caused by tag diversity to get a precise localization result. Also, Tadar requires the knowledge of the distribution of the observations when the object is at a certain location in order to calculate the emission probability of its HMM. Thus, Tadar is only suitable for small-scale through-wall localization applications.
  • Methods based on radar localize the target using radar methods [39,40]. Witrack [41] proposes a system based on Frequency-Modulated Continuous Wave (FMCW) that is capable of precise device-free localization and gesture recognition. The improved version [42] is able to localize multiple persons by applying successive cancellation. Its median localization accuracy is 10 to 13 cm. However, Witrack is built with a USRP device with high bandwidth and a specially designed T-shape antenna array, which limits the scale of its applications. Other radar-based systems have similar cost issues [43,44,45].

3. Channel Model of RFID backscatter

3.1. Technical Background

Consider a linear time-variant communication system that multiple transmitters transmit signals to a single receiver through a wireless channel. For a transmitted wireless signal denoted as s(t), the received signal can be expressed as:
y ( t ) = h · s [ t ] .
where h = α e j δ is a complex number known as the channel parameter [46]. α and δ are channel attenuation and phase rotation, respectively.
Another property of linear time-variant systems is used: when two sources A and B transmit simultaneously, the received signal can be represented as the combination of the signals from the two sources. This property is known as the rule of linear combination [47],
y ( t ) = y A ( t ) + y B ( t )
where y A ( t ) and y B ( t ) refer to the signal captured by the receiver when there is only A or B exists in the environment respectively.
In passive RFID systems, the communication is driven by the reader and the tag modulates the signal backscattered from its antenna to form a response. In common commercial readers, Received Signal Strength Indicator (RSSI) value and phase value are calculated after a tag Electronic Product Code (EPC) is demodulated successfully.

3.2. Channel Model

Now we consider the Line of Sight (LOS) path between a reader R and a tag T. In this situation, there are only two channels exists between reader R and tag T: forward channel and backward channel. Ideally, the channel parameters can be represented as [48]:
h R T i = h T i R = 1 d R T i 2 e j θ R T i ,
where d R T i is the distance between the Reader and the i-th tag. The θ R T i is the phase shift over the distance d R T i , which can be calculated given wavelength lambda of the carrier wave using the following formula:
θ R T i = 2 π d R T i λ   m o d   2 π .
Due to geometric symmetry of the forward channel and the backscatter channel, it is easy to see that d R T i = d T i R and h R T i = h T i R .
Denote the signal transmitted by the reader as S 0 , the signal reflected from tag T i and received by the reader can be represented as
S R i = S T i h T i T x h T i R h R R x .
However, in a real indoor environment, the signal is affected by multipath effect as there are lots of reflectors in the environment. First, consider the scenario that the tags are attached to the inner wall of a room and only static objects like chairs and walls exist in the environment. The tags and readers are all mounted on the walls so that people or other objects of interest do not obstruct the LOS path between the reader and the tags. Reflections caused by these objects can be treated as if they are from a single virtual reflection point W due to the principle of linear superimposing of signals [19].
Then the signal received by the tag can be represented as
S T i = S R T i + S R W T i .
which is a combined signal of the LOS path and the signal reflected by the environment.
S R W T i is given by:
S R W T i = S 0 h R T x h R W h w h W T i h T i R x .
In which h R T x is the transmitting parameter of reader antenna, h R W is the channel parameter of the channel between the reader antenna and virtual reflection point W. h w is the parameter introduced by reflecting at W, h T i R x is the receiving parameter of tag antenna.
So, we have:
S T i = S R T i + S R W T i = S 0 ( h R T x h R T i h T i R x + h R T x h R W h w h W T i h T i R x ) .
As is shown in Figure 1, if a moving object X enters the area of interest, it will introduce a third signal path propagating from the reader antenna, reflected by object X then received by the tag antenna. In this scenario, the signal received by the tag is given by:
S T i = S R T i + S R W T i + S R X T i
S R X T i = S 0 h R T x h R X h X h X T i h T i R x
S R i = S T i ( h T i T x h T i R h R R x + h T i T x h T i X h X h X R h R R x + h T i T x h T i W h w h W R h R R x ) ,
where S R X T i denotes the signal introduced by the moving object. S R i denotes the signal reflected by tag T i and received by the reader.

4. Proposed Positioning Algorithm

4.1. Data Preprocessing

In order to remove the interfering parameters, we perform operations as follows:
First, by subtracting (5) from (11), we get
S R i S R i = S T i ( h T i T x h T i R h R R x + h T i T x h T i X h X h X R h R R x + h T i T x h T i W h w h W R h R R x ) S T i ( h T i T x h T i R h R R x + h T i T x h T i W h w h W R h R R x )
where S R i is the tag-reflected signal when object X is present, and S R i is the tag-reflected signal when object X is absent.
Since the signal path that is introduced by the reflection of the surrounding environment and the target are much weaker than the LOS path, here we assume that the signal that is reflected twice during the round trip between the reader antenna and the tags can be negligible. Also, due to geometric symmetry, parameters like h T i R   is equal to its backward counterpart h R T i . Equation (12) is then simplified as:
S R i S R i = 2 S 0 h R T x h R X h X h X T i h T i R x h T i T x h T i R h R R x
Divide the result among the neighboring tags, we get
S R i + 1 S R i + 1 S R i S R i = h X T i + 1 h T i + 1 R h X T i h T i R
Here we assume that the tags are all of the same type and adjacent tags are close to each other. So that the differences of h T i T x of adjacent tags can be neglected. Since the locations of the readers and the tags are already known, h T i R can be calculated using Equation (3), thus, only h X T i component remains unknown.
By definition, h X T i is the loss of the X to T i path. It is a function of the distance between the tag and the moving object. It has the same form with h T i R . In light of this, h X T i + 1 / h X T i can be expressed as:
h X T i + 1 h X T i = 1 ( d X T i d X T i + 1 ) 2 e j ( θ X T i θ X T i + 1 ) .
Variable θ X T i is the phase shift over the distance between the moving object and the i-th tag. According to Equation (15), h X T i + 1 / h X T i can also be expressed in the form of Rssi and phase value, and the phase value is:
θ i = θ X T i θ X T i + 1
According to Equation (4), we have:
d i = d X T i d X T i + 1 = ( θ i 2 π + n ) λ ,               n Z
where n is an integer introduced due to phase wrapping, d i is the difference between distances to the location of the target. To eliminate the ambiguity caused by n, a popular method is to deploy tags with a small interval. In this case, the range of d i must be smaller than the wavelength of the carrier wave to prevent phase ambiguity. For a tag array that is infinitely long, the range of d i is two times the interval between the tags. Therefore, the spacing of the tags should be less than half of the carrier wavelength. For each tag pair, d i is determined, thus we know that the location of the target is on a hyperbola for which d i is the focal distance and the locations of the two tags are the foci.

4.2. Particle Swarm Optimization

From Section 3.1 we know that the target location is on the hyperbolas with the tag pairs as their foci. The traditional method computes the target location by solving the points of intersection of the hyperbolas. However, this method not only has high computational costs, but also has low localization accuracy due to the low Signal to Noise Ratio (SNR) of backscattered signal.
Another approach to address the issue is by finding the position that most likely produces the set of θ values observed. We use Particle swarm optimization (PSO) algorithm to solve this problem.
PSO algorithm is an efficient evolutionary computational technique for dealing with complex optimization problems. It is motivated by the behavior of a bird flock searching for food, in which birds tend to move towards the position with the most food that has been found by the flock. In each iteration of the algorithm, the basic component of the algorithm referred to as a particle, move toward the best performing particle and the best position found by the particle itself. After updating the positions of the particles, the evaluation of each particle is calculated, and the best positions are updated [49,50]. The particles will converge on the best position found by the particle swarm, thus solving the optimization problem. The algorithm is efficient and can easily benefit from multithread computational acceleration.

4.3. Positioning Using PSO Algorithm

WallSense treats the positioning problem as an optimization problem. By performing preprocessing, WallSense transforms RSSI and phase values to phase difference from the moving object to each tag pair. For each position in the area under surveillance, theoretical phase difference values of all the tag pairs can be calculated since the position of all the tags are already known. Thus, the positioning problem is transformed into an optimization problem in which the error between the measured phase difference values and the theoretical phase difference values is minimized.

4.3.1. Objective Function

For a set of measurements, WallSense first calculates the θ ^ i values according to the processes described above. For a particle that has position value X q , WallSense generates the theoretical θ i ( X q ) values according to the model. The output of the objective function is the Euclidean distance of the two set of θ values.
Taking measurement noise of the reader into account, the signal measured by the reader when the target is not in the environment can be expressed as:
S R i = ( S R T i + S R W T i ) h T i h T i T x h T i R h R R x +   ε ,   ε ~ N ( μ , σ 2 ) .
In which ε represents measurement noise. The signal measured by the reader when the target is in the environment can be expressed as:
S R i = ( S R T i + S R W T i + S R X T i ) h T i h T i T x h T i R h R R x +   ε ,   ε ~ N ( μ ,   σ 2 ) .
Since all the measurements are taken with one reader, we assume the noise terms of all the measurements have the same parameters. By subtracting the signals measured without the target object in the area from the signal measured with the target object in the area, we extract the signal that transfers through the extra propagation path introduced by the target object. Subtracting (18) from (19), we get:
S R i S R i = S R X T i R +   ε .
In which,
S R X T i R = S R X T i h T i h T i T x h T i R h R R x 1 d T i R 2 ,
ε = ε ε ,   ε ~ N ( 0 ,   2 σ 2 ) .
The SNR of the i-th tag, S N R i , can be expressed as:
S N R i =   P ( S R X T i R ) P ( ε ) 1 / d T i R 4 .
Since the power of this signal is in reverse relation with the distance between the tag and the target object, signal backscattered from tags closer to the target object tend to have higher SNR.
Although the distance between the target and the tag pair is still unknown, for an array of tags that is uniformly arranged in a direct line, the tag pairs closer with the target object have smaller distance difference to the target, thus they also produce smaller θ values. Thus, we weight the error of each tag pairs with a term e | θ ^ i | , to give more importance to the tag pairs that has smaller θ values, as they are more probable to be closer to the target object.
F ( X q ) = {   i = 1 n 1 [ ( θ i ( X q ) θ ^ i ) · ( e | θ ^ i | ) ] 2 } 1 / 2
Note that θ i ( X q ) θ ^ i is weighted with e | θ ^   i | , which is negatively correlated with the distance between the tag pairs and the moving object, thus reducing the influence of outlying tag pairs, which tend to have higher error because of the reflected signal is weaker.

4.3.2. Swarm Initialization, Inertial Weight, Learning Factors and Population

On each dimension, WallSense initialize the positions of the particles randomly based on a uniform distribution defined in the area of interest.
The initial velocity of each particle is set to half of the distance between the particle and a random position in the area of interest. For each dimension d, the initial velocity of the n-th particle is:
v ( 0 ) n , d = 0.5 ( U ( x m i n , d , x m a x , d ) x ( 0 ) n , d )
where x ( 0 ) n , d is the initial location of the n-th particle in dimension d, x m i n , d   and   x m a x , d are the lower and upper bound of the location of the particles in dimension d. To promote exploration in early optimization stages and reduce oscillation in later stages, WallSense uses a linearly decreasing inertial weight defined by [49]:
w ( t ) = w 0 ( w 0 w m i n ) t T m a x .
where w 0 is the starting value of inertial weight, w m i n is the desired minimum value of inertial weight and T m a x is the total number of iterations. T m a x is set to 100.
To get the best performance, WallSense used PSO algorithm and a training set to let the PSO learn the best learning factors for solving this positioning problem.
The swarm population N is calculated according to the empirical formula [50]
N = I n t ( 10 + 2 D )
where D = 2 is the dimension of the problem and Int() is the integer part function.

4.3.3. Enhancing Localization Accuracy and Robustness

To further enhance the localization accuracy and robustness of the system, we adopted a technique to locate x axis and y axis of the target object separately. Because the location of the target is basically the intersection of all the parabolas defined by the tag pairs and d i , one tag array tends to have high localization accuracy on the axis that is parallel to the tag array but have very low accuracy on the axis that is orthogonal to the tag array. We then used two separate tag arrays to locate x axis and y axis respectively. As is shown in Figure 2, the circle shows the ground truth. The accuracy difference of one array on the two axes can be very large. By discarding erroneous results and combining the accurate axis of the two arrays, this method can achieve higher accuracy compared to locating x axis and y axis using data from the two tag arrays at the same time. This is because when combining the data from the two tag arrays, the bad performance that one array has on the orthogonal axis would affect the good performance of the other array, resulting in worse overall performance.

4.4. Algorithm Summary

The discussion above has shed light on how to extract the reflection of the moving object as features and how to track the position of the moving object by using PSO algorithm. By putting them together, we get the following algorithm below:
Step 1: WallSense learns the backscatter signal S R that involves reflections from static objects in the environment with tags attached to the wall.
Step 2: When the object of interest is in the test environment, WallSense measures the backscatter signal S R of each tag at each frame.
Step 3: WallSense calculates S R i + 1 S R i + 1 S R i S R i .
Step 4: WallSense calculates h X T i + 1 h T i + 1 R / h X T i h T i R according to Equation (14).
Step 5: WallSense calculates h X T i + 1 / h X T i by removing h T i + 1 R / h T i R according to the deployed locations of the antennas and tags.
Step 6: WallSense calculates θ i according to Equation (15).
Step 7: The set of θ i is fed into the PSO algorithm to determine the location of the target object. To boost accuracy and robustness, the objective value is weighted with e | θ ^   i | for each tag pairs, and the X and Y coordinate are calculated separately with data collected from two orthogonal tag arrays.

5. Implementation

To evaluate the performance of WallSense in real world applications, we build a prototype of WallSense using COTS RFID reader and tags.

5.1. Hardware

We use an Impinj Speedway R420 model [51] with manufacturer provided firmware and software. The reader is compatible with EPC Class 1 Generation 2 tags. It operates in 920 MHz~926 MHz band and provide an interface for acquiring Rssi and phase data for each successful identification.
The inlay of the tags used in our experiment is AZ9662 with Higgs-3 chip [52]. Before the experiment, the tags are tested using Voyantic Tagformance Pro [53] to ensure that they have similar frequency response, thus eliminating the h T i factor in (12). Tags that have bad performance are considered defective tags and are not used in our experiments. The Tags are arranged on foam boards for performance issues when attached directly on concrete walls. The spacing between adjacent tags is 15 cm.
The antennas used in our experiments are Laird S9028PCL circular polarization antennas [54] with 9dBi gain. The size of the antennas is 25.5 cm × 25.5 cm × 3.2 cm. The maximum read range of the RFID system equipped with this antenna is about 10~12 m.
We use a BOSCH GLM 30 laser rangefinder [55] to measure and calibrate the location of the antennas and tags. The location of the targets is measured with a tape measure with the help of a grid drawn on the floor.

5.2. Software

Because the MultiReader software provided with the R420 readers does not provide phase information and cannot save more than a certain number of records, we developed a windowed software using Impinj Software Developer’s Kit (SDK) [56] to collect Rssi and phase data. The software is able to control readers that support the Low Lever Reader Protocol (LLRP) [57] through Ethernet cables and save the inventory history to a file. Localization algorithm is implemented in Matlab. The software and localization process run on a laptop with Intel I5-7300HQ CPU operating at 2.5 GHz and 8 GB memory. During the experiments, the read mode of the reader is set to MaxThroughput so that the reader dynamically adjusts the number of time slots in each frame based on the estimated tag population. Note that in this mode, the tags respond with FM0 coded bursts that have the highest data rate. This enables the reader to identify more than 200 tags per second.

6. Evaluation

In this section, the performance of WallSense is evaluated from aspects of localization accuracy, impact of distance to the tag array and impact of carrier frequency. The experiments are conducted in a large empty room of 11 m × 9.3 m × 3 m. The room has concrete wall, ceramic tile flooring and suspended ceiling with metal hangers and gypsum tiles. Metal ceiling fans are mounted on the ceiling. The experimental setup is shown in Figure 3. Two sets of tag arrays are deployed on the opposite wall of two antennas, covering a surveillance area of 4 m × 4 m. The “walls” that supports the tag arrays are stacks of cartons. Each set of tag arrays has 25 tags. The tags are deployed with 15 m spacing to prevent phase ambiguity in preprocessing. A reflective box of size 0.25 m × 0.37 m × 1.55 m and three volunteers of different height (1.65 m, 1.73 m, 1.78 m respectively) and build (51 kg, 60 kg, 68 kg respectively) served as the localization target in the experiments. The reflective box is a stack of 3 cartons coated with tin foil, which forms a highly reflective surface. Note that the coordinate of a target person is defined as the geometric center of his heels. The coordinates are measured with a tape measure and serve as the truth value in our experiments.
WallSense collects a set of RSSI and phase data of the tags when no target is in the area of interest as the reference. Note that this process only takes seconds and is very different from constructing a traditional radio map. We tested 120 uniformly distributed random positions in the area of interest. At each location, we collected the inventory data for 1 second and calculate the average RSSI and phase value to use as one sample. Of the three human targets, a total of 360 samples were collected.

6.1. Localization Accuracy

First, we evaluate the localization accuracy using one set of tag array and antenna. On each tag array, 21 tags are used to localize the target. Analyzing the localization result of both arrays, we found that the average localization accuracy of reflective box target is 0.18 m on the parallel axis, 1.60 m on the orthogonal axis. The average localization accuracy of human targets is 0.12 m on the parallel axis and 1.14 m on the orthogonal axis. Note that the localization error is defined as the distance between the localization result and the ground truth value.
Figure 4 plots the localization accuracy of the system using two sets of tag arrays. The median localization error of the proposed method with human targets is 0.24 m, which is accurate considering the size of the human body. It can be seen on the figure that WallSense have high robustness by performing PSO twice. Using weighted PSO, WallSense yields a much better result than Least Squares (LS) based methods. The PSO algorithm converges in 30 iterations on average, which takes about several milliseconds.
We also evaluated the accuracy of WallSense when the reader was working at different frequencies. The results show that the localization accuracy remains stable with the change of carrier frequency.
Figure 5 compares WallSense with other device-free indoor localization methods. Keep in mind that WallSense is a low-cost solution that only use off-the-shelf products and don’t require site surveying and carried devices.

6.2. Impact of the Number of Deployed Tags

To evaluate the impact of the number of deployed tags on the performance of WallSense, we compared the performance of the methods with the data of different number of tags in each tag array. The result is shown in Figure 5b.
For each method tested, the localization error first drops, then rises with increasing number of deployed tags. This is because when the number of deployed tags is below a threshold (about 15~19 tags each array), the information provided by the tags is not sufficient to rule out the influence of noise. When the number of deployed tags is beyond the threshold, the added tags are further away from the center of the tag array, these tags have low SNR and thus lower the localization accuracy of the system.
However, it is possible to solve this problem by adding a tag-selection strategy for the particles. We implemented a strategy in WallSense that only picks a certain number of tags that are closest to a particle when calculating its fitness value. We found that the system is able to achieve a good overall result that is close to the result when an optimal number of tags are deployed. Using this method, WallSense can deploy as many tags as possible without worrying about lowering its accuracy. However, as is shown in Figure 6, there are rare cases in which the localization result become worse. Further studies into this subject are needed to improve the robustness of this method.

6.3. Cost

Low cost is a major advantage of our method compared to previous solutions. Utilizing only off-the-shelf readers and tags, WallSense is able to cover one room with two sets of tag array and two antennas. Due to the low cost of RFID tags (about $0.1 each), the tag arrays cost only several dollars in total. The antennas cost about $200. In our experiments, we adopt ImpinJ R420, a powerful reader which costs about $2000. But in real applications, this system can be deployed with cheaper readers such as the ThingMagic readers, which cost about $700. Furthermore, as most RFID readers support 4 or more antenna port, two adjacent rooms can share one reader.
Although the location of the antennas and tags are required, the method requires no radio map and the target person doesn’t have to carry any additional devices.

7. Conclusions

In conclusion, WallSense is the first device-free indoor localization system that utilizes wall-mounted tag arrays to provide accurate indoor localization. By combining a PSO-based localization algorithm with a weighted objective function and deploying orthogonal tag arrays to locate x and y axis of the target location separately, WallSense is able to accurately and robustly locate human beings in an indoor setting. Comprehensive experiments prove that WallSense is an effective and promising indoor localization method that can strike a good balance between cost and performance.

Author Contributions

L.M. conceived and designed the experiments; H.W. and Y.Y supervised the research; L.M., M.L., N.W. and Y.Z. performed the implementations and experiments; L.M. and M.L analyzed the results from the experiments. L.M. wrote the paper.

Funding

This research was funded by the National Key R&D Program of China, grant number 2018YFF01014304.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

EPCElectronic Product Code
FMCWFrequency-Modulate Continuous Wave
GPSGlobal Positioning System
HMMHidden Markov Model
KNNK Nearest Neighbor
LOSLine of Sight
LSLeast Squares
PSOParticle Swarm Optimization
RFIDRadio-Frequency Identification
RSSIReceived Signal Strength Indicator
SNRSignal to Noise Ratio
SDKSoftware Developer’s Kit
UHFUltra-High Frequency
USRPUniversal Software Radio Peripheral
WKNNWeighted KNN

References

  1. Chen, W.H.; Chang, H.H.; Lin, T.H.; Chen, P.C. Dynamic Indoor Localization Based on Active RFID for Healthcare Applications: A Shape Constraint Approach. In Proceedings of the International Conference on Biomedical Engineering and Informatics, Tianjin, China, 17–19 October 2009; pp. 1–5. [Google Scholar]
  2. Wyffels, J.; De, B.J.; Crombez, P.; Verhoeve, P.; Nauwelaers, B.; De, S.L. Distributed, signal strength-based indoor localization algorithm for use in healthcare environments. IEEE J. Biomed. Health Inform. 2014, 18, 1887–1893. [Google Scholar] [CrossRef] [PubMed]
  3. Chen, P.W.; Ou, K.S.; Chen, K.S. IR indoor localization and wireless transmission for motion control in smart building applications based on Wiimote technology. In Proceedings of the ICNC, Taipei, Taiwan, 18–21 August 2010; pp. 1781–1785. [Google Scholar]
  4. Chen, K.C.; Tsai, W.H. Vision-Based Autonomous Vehicle Guidance for Indoor Security Patrolling by a SIFT-Based Vehicle-Localization Technique. IEEE Trans. Veh. Technol. 2010, 59, 3261–3271. [Google Scholar] [CrossRef]
  5. Hwang, I.; Jang, Y.J. Process Mining to Discover Shoppers’ Pathways at a Fashion Retail Store Using a WiFi-Base Indoor Positioning System. IEEE Trans. Autom. Sci. Eng. 2017, 14, 1786–1792. [Google Scholar] [CrossRef]
  6. Han, D.; Chen, Q.; Han, J.; Wang, G.; Wei, X.; Zhao, K.; Zhao, J. RFIPad: Enabling Cost-Efficient and Device-Free In-air Handwriting Using Passive Tags. In Proceedings of the IEEE International Conference on Distributed Computing Systems, Atlanta, GA, USA, 5–8 June 2017; pp. 447–457. [Google Scholar]
  7. Stelios, M.A.; Nick, A.D.; Effie, M.T.; Dimitris, K.M.; Thomopoulos, S.C.A. An indoor localization platform for ambient assisted living using UWB. In Proceedings of the International Conference on Advances in Mobile Computing and Multimedia, Linz, Austria, 24–26 November 2008; pp. 178–182. [Google Scholar]
  8. Potorti, F.; Park, S.; Jimenez Ruiz, A.R.; Barsocchi, P.; Girolami, M.; Crivello, A.; Lee, S.Y.; Lim, J.H.; Torres-Sospedra, J.; Seco, F.; et al. Comparing the Performance of Indoor Localization Systems through the EvAAL Framework. Sensors 2017, 17, 2327. [Google Scholar] [CrossRef] [PubMed]
  9. Gonzalez, J.; Blanco, J.L.; Galindo, C.; Ortiz-De-Galisteo, A.; Fernandez-Madrigal, J.A.; Moreno, F.A.; Martinez, J.L. Combination of UWB and GPS for indoor-outdoor vehicle localization. In Proceedings of the IEEE International Symposium on Intelligent Signal Processing, Alcala de Henares, Spain, 3–5 October 2007; pp. 1–6. [Google Scholar]
  10. Ma, L.; Wang, L.; Yang, Y.; Wang, H. Test Method for UHF RFID Readers in Dense Environment. In Proceedings of the Chinese Control Conference (CCC), Dalian, China, 26–28 July 2017; pp. 9025–9029. [Google Scholar]
  11. Youssef, M.; Mah, M.; Agrawala, A. Challenges: Device-free passive localization for wireless environments. In Proceedings of the ACM International Conference on Mobile Computing and NETWORKING, Montréal, QC, Canada, 9–14 September 2007; pp. 222–229. [Google Scholar]
  12. Jin, Z.; Bu, Y.; Liu, J.; Wang, X.; An, N. Development of Indoor Localization System for Elderly Care Based on Device-Free Passive Method. In Proceedings of the Sixth International Conference on Intelligent Systems Design and Engineering Applications, Guiyang, China, 18–19 August 2016; pp. 328–331. [Google Scholar]
  13. Zhang, J.; Xiao, W.D.; Zhang, S.; Huang, S.D. Device-Free Localization via an Extreme Learning Machine with Parameterized Geometrical Feature Extraction. Sensors 2017, 17, 879. [Google Scholar] [CrossRef] [PubMed]
  14. Lu, G.; Yan, Y.; Kolagunda, A.; Kambhamettu, C. A Fast 3D Indoor-Localization Approach Based on Video Queries. In Proceedings of the International Conference on Multimedia Modeling, Miami, FL, USA, 4–6 January 2016; pp. 218–230. [Google Scholar]
  15. Garcia-Valverde, T.; Garcia-Sola, A.; Hagras, H.; Dooley, J.A.; Callaghan, V.; Botia, J.A. A Fuzzy Logic-Based System for Indoor Localization Using WiFi in Ambient Intelligent Environments. IEEE Trans. Fuzzy Syst. 2013, 21, 702–718. [Google Scholar] [CrossRef]
  16. Kolkowska, E. Privacy Principles in Design of Smart Homes Systems in Elderly Care, 1st ed.; Springer International Publishing: Berlin, Germany, 2015; pp. 526–537. [Google Scholar]
  17. Caine, K.; Šabanovic, S.; Carter, M. The effect of monitoring by cameras and robots on the privacy enhancing behaviors of older adults. In Proceedings of the ACM/IEEE international conference on Human-Robot Interaction, Boston, MA, USA, 5–8 March 2012; pp. 343–350. [Google Scholar]
  18. Tian, Z.; Zhou, X.; Zhou, M.; Li, S.; Shao, L. Indoor device-free passive localization for intrusion detection using multi-feature PNN. In Proceedings of the International Conference on Communications and NETWORKING in China, Shanghai, China, 15–17 August 2016; pp. 272–277. [Google Scholar]
  19. Yang, L.; Lin, Q.; Li, X.; Liu, T.; Liu, Y. See Through Walls with COTS RFID System! In Proceedings of the International Conference on Mobile Computing and NETWORKING, Paris, France, 7–11 September 2015; pp. 487–499. [Google Scholar]
  20. Yang, L.; Chen, Y.; Li, X.Y.; Xiao, C.; Li, M.; Liu, Y. Tagoram: Real-time tracking of mobile RFID tags to high precision using COTS devices. In Proceedings of the International Conference on Mobile Computing and NETWORKING, Maui, HI, USA, 7–11 September 2014; pp. 237–248. [Google Scholar]
  21. Ahmed, T.; Pedersen, T.B.; Lu, H. A Data Warehouse Solution for Analyzing RFID-Based Baggage Tracking Data. In Proceedings of the IEEE International Conference on Mobile Data Management, Washington, DC, USA, 3–6 June 2013; pp. 283–292. [Google Scholar]
  22. Palipana, S.; Pietropaoli, B.; Pesch, D. Recent advances in RF-based passive device-free localisation for indoor applications. Ad Hoc Netw. 2017, 64, 80–98. [Google Scholar] [CrossRef]
  23. Li, C.; Qiu, Z.; Liu, C. An Improved Weighted K-Nearest Neighbor Algorithm for Indoor Positioning. Wirel. Pers. Commun. 2017, 96, 1–13. [Google Scholar] [CrossRef]
  24. Wang, H.; Sen, S.; Mariakakis, A.; Elgohary, A.; Farid, M.; Youssef, M.; Choudhury, R.R. Video: Unsupervised indoor localization (UnLoc): Beyond the prototype. In Proceedings of the International Conference on Mobile Systems, Applications, and Services, Bretton Woods, NH, USA, 16–19 June 2014; p. 393. [Google Scholar]
  25. Moutinho, J.N.; Araújo, R.E.; Freitas, D. Indoor localization with audible sound—Towards practical implementation. Pervasive Mob. Comput. 2016, 29, 1–16. [Google Scholar] [CrossRef]
  26. Bin, X.U.; Xia, X.H. Research on A Method of Indoor Sound Localization Using Microphone Array. J. Hefei Univ. 2015, 25, 30–34. [Google Scholar]
  27. Valtonen, M.; Maentausta, J.; Vanhala, J. TileTrack: Capacitive human tracking using floor tiles. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications, Galveston, TX, USA, 9–13 March 2009; pp. 1–10. [Google Scholar]
  28. Zhang, D.; Ma, J.; Chen, Q.; Ni, L.M. An RF-Based System for Tracking Transceiver-Free Objects. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications, White Plains, NY, USA, 19–23 March 2006; pp. 135–144. [Google Scholar]
  29. Lv, J.; Man, D.; Yang, W.; Du, X.; Yu, M. Robust WLAN-based Indoor Intrusion Detection Using PHY Layer Information. IEEE Access 2017, 6, 30117–30127. [Google Scholar] [CrossRef]
  30. Liu, H.; Ni, Y.-P.; Wang, Z.H.; Xu, S.-X.; Bu, X.-Y.; An, J.-P. Time-Varying Multi-Target Tracking Method Based on Particle Filter in Radio Tomographic Network. Trans. Beijing Inst. Technol. 2017, 37, 526–531. [Google Scholar] [CrossRef]
  31. Lim, J.; Chong, U. Multitarget tracking by particle filtering based on RSS measurement in wireless sensor networks. Int. J. Distrib. Sens. Netw. 2015, 2015, 72. [Google Scholar] [CrossRef]
  32. Mager, B.; Lundrigan, P.; Patwari, N. Fingerprint-Based Device-Free Localization Performance in Changing Environments. IEEE J. Sel. Areas Commun. 2015, 33, 2429–2438. [Google Scholar] [CrossRef]
  33. Pirzada, N.; Nayan, M.Y.; Hassan, M.F.; Subhan, F.; Sakidin, H. WLAN location fingerprinting technique for device-free indoor localization system. In Proceedings of the ICCOINS, Kuala Lumpur, Malaysia, 15–17 August 2017; pp. 1–11. [Google Scholar]
  34. Ruan, W.; Yao, L.; Sheng, Q.Z.; Falkner, N.J.G.; Li, X. TagTrack: Device-free localization and tracking using passive RFID tags. In Proceedings of the International Conference on Mobile and Ubiquitous Systems: Computing, NETWORKING and Services, London, UK, 2–5 December 2014; pp. 80–89. [Google Scholar]
  35. Xu, C.; Firner, B.; Moore, R.S.; Zhang, Y.; Trappe, W.; Howard, R.; Zhang, F.; An, N. SCPL: Indoor device-free multi-subject counting and localization using radio signal strength. In Proceedings of the ACM/IEEE International Conference on Information Processing in Sensor Networks, Philadelphia, PA, USA, 8–11 April 2013; pp. 79–90. [Google Scholar]
  36. Parr, A.; Miesen, R.; Vossiek, M. Comparison of Phase-Based 3D Near-Field Source Localization Techniques for UHF RFID. Sensors 2016, 16, 978. [Google Scholar] [CrossRef] [PubMed]
  37. Liu, M.; Wang, H.; Yang, Y.; Zhang, Y.; Li, L.; Xu, J.; Du, Y.; Ma, L.; Wang, N.; Liu, M. RFID indoor localization system for tag and tagfree target based on interference. In Proceedings of the International Conference on Advanced Communication Technology, Bongpyeong, Korea, 13–17 March 2017; pp. 372–376. [Google Scholar]
  38. Wang, J.; Xiong, J.; Jiang, H.; Chen, X.; Fang, D. D-Watch: Embracing “Bad” Multipaths for Device-Free Localization with COTS RFID Devices. IEEE/ACM Trans. Netw. 2017, 25, 3559–3572. [Google Scholar] [CrossRef]
  39. Kilic, Y.; Wymeersch, H.; Meijerink, A.; Bentum, M.J. An experimental study of UWB device-free person detection and ranging. In Proceedings of the IEEE International Conference on Ultra-Wideband, Sydney, Australia, 15–18 September 2013; pp. 43–48. [Google Scholar]
  40. Nguyen, V.H.; Pyun, J.Y. Location Detection and Tracking of Moving Targets by a 2D IR-UWB Radar System. Sensors 2015, 15, 6740–6762. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Adib, F.; Kabelac, Z.; Katabi, D.; Miller, R.C. 3D Tracking via Body Radio Reflections. NSDI 2014, 317–329. [Google Scholar] [CrossRef]
  42. Adib, F.; Kabelac, Z.; Katabi, D. Multi-person localization via RF body reflections. In Proceedings of the Usenix Conference on Networked Systems Design and Implementation, Oakland, CA, USA, 4–6 May 2015; pp. 279–292. [Google Scholar]
  43. Sorrentino, R.; Sbarra, E.; Urbani, L.; Montori, S. Accurate FMCW radar-based indoor localization system. In Proceedings of the IEEE International Conference on Rfid-Technologies and Applications, Nice, France, 5–7 November 2012; pp. 362–368. [Google Scholar]
  44. Cole, R.; Jameson, B.; Garmatyuk, D.; Morton, Y.T.J. Simultaneous indoor localization and detection with multi-carrier radar. In Proceedings of the Radar Conference, Cincinnati, OH, USA, 19–23 May 2014; pp. 0881–0886. [Google Scholar]
  45. Wang, G.; Gu, C.; Inoue, T.; Li, C. A Hybrid FMCW-Interferometry Radar for Indoor Precise Positioning and Versatile Life Activity Monitoring. IEEE Trans. Microw. Theory Tech. 2014, 62, 2812–2822. [Google Scholar] [CrossRef]
  46. Dobkin, D. The RF in RFID, 1st ed.; Elsevier: Amsterdam, The Netherlands, 2013. [Google Scholar]
  47. Pahlavan, K. Principles of Wireless Access and Localization, 1st ed.; John Wiley & Sons Inc.: Hoboken, NJ, USA, 2013. [Google Scholar]
  48. Rappaport, T.S. Wireless Communications: Principles and Practice/T.S. Rappaport; Pearson Education, Inc.: London, UK, 2002; Volume 8, pp. 33–38. [Google Scholar]
  49. Parsopoulos, K.E.; Vrahatis, M.N. Particle Swarm Optimization and Intelligence: Advances and Applications, 1st ed.; IGI Global: Hershey, PA, USA, 2007; pp. 28–29. [Google Scholar]
  50. Panigrahi, B.K.; Shi, Y.; Lim, M.H. Handbook of Swarm Intelligence; Springer: Berlin/Heidelberg, Germany, 2011. [Google Scholar]
  51. Impinj Speedway Reader. Available online: https://www.impinj.com/platform/connectivity/speedway-r420/ (accessed on 11 December 2018).
  52. Alien Tags. Available online: https://www.alientechnology.com/products/tags/ (accessed on 11 December 2018).
  53. Voyantic Tagformance Pro. Available online: http://voyantic.com/products/tagformance-pro (accessed on 11 December 2018).
  54. Laird S902 Series. Available online: https://connectivity.lairdtech.com/rf-antennas/rfid-antennas/s902-series-rfid (accessed on 11 December 2018).
  55. BOSCH Rangefinder. Available online: https://www.amazon.cn/dp/B00MQKJ8OQ (accessed on 11 December 2018).
  56. Impinj SDK. Available online: https://support.impinj.com/hc/en-us/articles/202755268-Octane-SDK (accessed on 11 December 2018).
  57. LLRP Standard. Available online: https://www.gs1.org/standards/epc-rfid/llrp/1-1-0 (accessed on 11 December 2018).
Figure 1. The signal propagation model.
Figure 1. The signal propagation model.
Sensors 19 00068 g001
Figure 2. An example of using data from two arrays separately to improve localization result.
Figure 2. An example of using data from two arrays separately to improve localization result.
Sensors 19 00068 g002
Figure 3. (a) Wall-mounted tag arrays and antennas in WallSense. (b) Tags are attached onto foamed plastic pads. The figure also shows the R420 reader used in our experiments. (c) Deployment layouts with the positions of tag arrays, antennas and test area marked.
Figure 3. (a) Wall-mounted tag arrays and antennas in WallSense. (b) Tags are attached onto foamed plastic pads. The figure also shows the R420 reader used in our experiments. (c) Deployment layouts with the positions of tag arrays, antennas and test area marked.
Sensors 19 00068 g003
Figure 4. Localization accuracy of the proposed method, compared with Least Squares (LS)-based optimization. (a) Results with reflective box target. (b) Results with human target.
Figure 4. Localization accuracy of the proposed method, compared with Least Squares (LS)-based optimization. (a) Results with reflective box target. (b) Results with human target.
Sensors 19 00068 g004
Figure 5. (a) The performance of WallSense compared with other device-free localization methods. (b) Impact of the number of deployed tags.
Figure 5. (a) The performance of WallSense compared with other device-free localization methods. (b) Impact of the number of deployed tags.
Sensors 19 00068 g005
Figure 6. Comparison of the cumulative distribution function of the methods based on Particle Swarm Optimization (PSO). A total number of 50 tags are deployed. Subset PSO selects 34 of them for each particle.
Figure 6. Comparison of the cumulative distribution function of the methods based on Particle Swarm Optimization (PSO). A total number of 50 tags are deployed. Subset PSO selects 34 of them for each particle.
Sensors 19 00068 g006

Share and Cite

MDPI and ACS Style

Ma, L.; Liu, M.; Wang, H.; Yang, Y.; Wang, N.; Zhang, Y. WallSense: Device-Free Indoor Localization Using Wall-Mounted UHF RFID Tags. Sensors 2019, 19, 68. https://doi.org/10.3390/s19010068

AMA Style

Ma L, Liu M, Wang H, Yang Y, Wang N, Zhang Y. WallSense: Device-Free Indoor Localization Using Wall-Mounted UHF RFID Tags. Sensors. 2019; 19(1):68. https://doi.org/10.3390/s19010068

Chicago/Turabian Style

Ma, Liang, Meng Liu, Hongjun Wang, Yang Yang, Na Wang, and Yajun Zhang. 2019. "WallSense: Device-Free Indoor Localization Using Wall-Mounted UHF RFID Tags" Sensors 19, no. 1: 68. https://doi.org/10.3390/s19010068

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop