Next Article in Journal
Inertial Sensor Self-Calibration in a Visually-Aided Navigation Approach for a Micro-AUV
Next Article in Special Issue
3D Modeling of Building Indoor Spaces and Closed Doors from Imagery and Point Clouds
Previous Article in Journal
Pose Estimation with a Kinect for Ergonomic Studies: Evaluation of the Accuracy Using a Virtual Mannequin
Previous Article in Special Issue
Received Signal Strength Recovery in Green WLAN Indoor Positioning System Using Singular Value Thresholding
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Fast and Precise Indoor Localization Algorithm Based on an Online Sequential Extreme Learning Machine †

School of Electrical and Electronics Engineering, Nanyang Technological University, 50 Nanyang Ave, Singapore 639798, Singapore
*
Author to whom correspondence should be addressed.
This paper is an extended version of the paper entitled “An Online Sequential Extreme Learning Machine Approach to WiFi Based Indoor Positioning”, presented at 2014 IEEE World Forum on Internet of Things (WF-IoT), Seoul, Korea, 6–8 March 2014.
Sensors 2015, 15(1), 1804-1824; https://doi.org/10.3390/s150101804
Submission received: 20 November 2014 / Accepted: 8 January 2015 / Published: 15 January 2015
(This article belongs to the Special Issue Sensors for Indoor Mapping and Navigation)

Abstract

: Nowadays, developing indoor positioning systems (IPSs) has become an attractive research topic due to the increasing demands on location-based service (LBS) in indoor environments. WiFi technology has been studied and explored to provide indoor positioning service for years in view of the wide deployment and availability of existing WiFi infrastructures in indoor environments. A large body of WiFi-based IPSs adopt fingerprinting approaches for localization. However, these IPSs suffer from two major problems: the intensive costs of manpower and time for offline site survey and the inflexibility to environmental dynamics. In this paper, we propose an indoor localization algorithm based on an online sequential extreme learning machine (OS-ELM) to address the above problems accordingly. The fast learning speed of OS-ELM can reduce the time and manpower costs for the offline site survey. Meanwhile, its online sequential learning ability enables the proposed localization algorithm to adapt in a timely manner to environmental dynamics. Experiments under specific environmental changes, such as variations of occupancy distribution and events of opening or closing of doors, are conducted to evaluate the performance of OS-ELM. The simulation and experimental results show that the proposed localization algorithm can provide higher localization accuracy than traditional approaches, due to its fast adaptation to various environmental dynamics.

1. Introduction

The widespread usage of mobile devices and the popularity of social networks have spurred extensive demands on location-based service (LBS) in recent years. In outdoor environments, GPS has dominated the LBS market with excellent localization performance. However, due to the lack of line of sight (LoS) transmission channels between satellites and a receiver, GPS is not capable of providing positioning service with sufficient localization accuracy in indoor environments [1]. Hence, developing an indoor positioning system (IPS) to provide reliable and precise indoor positioning and navigation has become a hot research topic recently. Various wireless communication technologies have been studied and developed to provide indoor positioning and navigation services in the past two decades [25]. Unlike other wireless technologies, such as ultra-wideband (UWB) and radio frequency identification (RFID), which require the deployment of extra infrastructure, the existing IEEE 802.11 (WiFi) network infrastructures, such as WiFi routers, are widely available in large numbers of commercial and residential buildings, and nearly every mobile device now is equipped with a WiFi receiver. As such, it is low-cost and practical to develop a WiFi-based IPS to provide LBS in an indoor environment [611].

Fingerprinting-based localization algorithms are widely adopted for WiFi-based indoor positioning, since the received signal strengths (RSS) can be measured easily from mobile devices [712]. However, the existing WiFi-based IPSs adopting the fingerprinting approach suffer from two major problems. One is that the site survey involves intensive costs of both time and manpower during the offline calibration phase. In order to achieve sufficient localization accuracy, the WiFi RSS fingerprints from different access points (APs) need to be measured at a huge number of calibration points. The other one is that the existing fingerprinting-based approaches are not robust to environmental dynamics [6,13]. Since the WiFi RSS fingerprint database is built up during the offline phase, it cannot reflect the real-time radio map of the WiFi signals well once the environment is altered during the online localization phase. Environmental factors, such as presence of humans, opening and closing of doors and variations of humidity, can interfere with the propagation of WiFi signals severely [6]. This will lead to serious localization errors in the estimation of the target if the same WiFi RSS fingerprint database is adopted.

In this paper, we propose an indoor localization algorithm based on an online sequential extreme learning machine (OS-ELM) to address the above two problems accordingly. Originating from the batch learning extreme learning machine (ELM), OS-ELM inherits the advantage of ELM, which can provide good generalization performance at an extremely fast learning speed [14]. In addition, OS-ELM has an online sequential learning ability that does not require retraining when new data are received [15]. Another noteworthy point of OS-ELM is that, different from other online sequential learning algorithms, such as stochastic gradient descent back-propagation (SGBP) [16] and growing and pruning RBF network (GAP-RBF) [17], which require specific types of hidden nodes and can only handle data one-by-one (learning only one training sample at each time), OS-ELM is able to adapt to various types of hidden nodes and can learn data one-by-one or chunk-by-chunk with a varying chunk size. Therefore, WiFi RSS fingerprints can be collected and updated more flexibly for OS-ELM online sequential learning. In addition, the fast learning speed of OS-ELM greatly reduces time consumption and manpower costs for the offline site survey. More importantly, the online sequential learning ability of OS-ELM permits the entire system to provide sufficient localization accuracy, even under environmental dynamics. A preliminary version of this paper was presented at the 2014 IEEE World Forum on the Internet of Things (WF-IoT) Conference [18]. In addition to the results in [18], a more elaborate description of the OS-ELM approach is presented in this paper. Furthermore, a simulation is conducted and demonstrated, as well. Besides overall performance evaluation and comparison between OS-ELM and existing fingerprinting-based approaches, experiments under specific environmental changes, such as variations of occupancy distribution and events of opening or closing of doors, are also conducted to evaluate the performance of OS-ELM in this paper.

The rest of the paper is organized as follows. In Section 2, we review related works. Section 3 provides the proposed localization algorithm. The simulation results and evaluation of OS-ELM are presented in Section 4. In Section 5, a system overview of our WiFi-based IPS is provided firstly, followed by the experimental results and performance evaluation of the proposed localization algorithm. We conclude the work in Section 6.

2. Related Works

Indoor localization algorithms have been extensively studied, and a number of approaches has been proposed over the past two decades [2,3]. These algorithms can be classified into two categories: model-based approaches and fingerprinting-based approaches.

2.1. Model-Based Approaches

Model-based approaches use geometrical models, such as time of arrival (ToA) [19] and time difference of arrival (TDoA) [20], to estimate the position of the target [21,22]. Several model-based approaches employing radio propagation models have been investigated in [23]. The log-distance path model, which estimates the RSS value based on the propagation distances, is one of the most popular models. For instance, weighted path loss (WPL) [24] can achieve a 2-m localization accuracy on RFID-based IPS. The AP locations and floor plans are also leveraged to improve the estimation of the RSS value for model-based approaches [7].

However, establishing a sophisticated indoor radio propagation model is very difficult, due to the irregular signal propagation in an indoor environment. Moreover, model-based approaches also suffer from the interference from different materials and mobile obstacles.

2.2. Fingerprinting-Based Approaches

A large body of existing IPSs adopt the other type of localization algorithms, namely the fingerprinting-based approaches, which usually involve two phases: an offline training phase and an online localization phase. During the offline training phase, a site survey dedicated to collecting the WiFi RSS fingerprints from different APs at some known locations is performed in the indoor environment, and consequently, a WiFi RSS fingerprint database is built up. During the online localization phase, when a user sends a location query containing his or her current WiFi RSS fingerprint, the location of the user will be estimated by matching the measured fingerprint with the fingerprints stored in the database, and the location associated with the matching fingerprint will be returned as his or her location estimation.

A majority of these approaches leverage RF signals for RSS fingerprinting. To name a few, Horus [8] is based on WiFi signals, while LANDMARC [25] utilizes RFID signals; FM radio [26], geomagnetisms [27,28] and GSM signals [29] are also adopted as fingerprints for indoor localization. Although fingerprinting-based approaches require a site survey to build up a fingerprint database during the offline phase, they can provide a higher localization accuracy than model-based approaches in general [2].

One of the disadvantages of existing fingerprinting-based approaches is the high calibration cost, as a labor-intensive offline site survey is required to build up the RSS fingerprint database. Moreover, the static database is vulnerable to environmental dynamics. The offline site survey needs to be reconstructed when any environmental factor is altered, which involves extensive maintenance costs and efforts.

3. An Indoor Localization Algorithm

3.1. Preliminary on OS-ELM

ELM is a type of machine learning algorithm based on a single-hidden layer feedforward neural network (SLFN) architecture. OS-ELM on the basis of ELM was developed for SLFNs with additive hidden nodes [15]. Assume there are N arbitrary distinct training samples (xi, ti) ∈ Rn × Rm, where x are the training inputs and t are the training targets. If a SLFN with L hidden nodes can approximate these N samples with zero error, there exist βi, ai and bi, such that:

f L ( x j ) = i = 1 L β i G ( a i , b i , x j ) = t j , j = 1 , 2 , , N
where ai and bi are the learning parameters of the hidden nodes, βi is the output weight and G(ai, bi, xj) is the activation function, which gives the output of the i-th hidden node with respect to the input xj. If the hidden node is additive, G(ai,bi,xj) = g(aixj + bi), biR, where ai is the input weight vector, bi is the bias of the i-th hidden node and ai • xj denotes the inner product of the two.

The OS-ELM algorithm contains two phases: an initialization phase and a sequential learning phase. One special property of OS-ELM is that it can learn data one-by-one or chunk-by-chunk (a block of data) with a fixed or varying chunk size [15]. Suppose the network has L hidden nodes and the data Sensors 15 01804i1 = {(xi, ti) |xi ∈ Rn, ti ∈ Rm, i = 1,…, N} are presented to the network sequentially. In the initialization phase, rank(H0) = L is required to ensure that OS-ELM can achieve the same learning performance as ELM, where H0 denotes the hidden output matrix for the initialization phase. The number of training data required in the initialization phase, N0, has to be equal to or greater than L, i.e., N0L. If N0 = N, the performance of OS-ELM is the same as batch ELM. Therefore, batch ELM is a special case of OS-ELM when all of the data are used in the initialization phase.

Initialization phase: a small chunk of training data Sensors 15 01804i10 is used to initialize the learning, where N 0 = { x i , t i } i = 1 N 0 N and N0L.

Step 1

Randomly assign the input parameters: input weights ai and bias bi,i= 1,…, L.

Step 2

Calculate the initial hidden layer output matrix H0 =

[ G ( a 1 , b 1 , x 1 ) G ( a L , b L , x 1 ) G ( a 1 , b 1 , x N 0 ) G ( a L , b L , x N 0 ) ] N 0 × L

Step 3

Estimate the initial output weight β(0). Since T 0 = [ t 1 , t N 0 ] N 0 × m T, the problem is equivalent to minimizing ‖H0βT0‖. Noticing that H† = (HTH)−1HT [14], the optimal solution is given by β ( 0 ) = P 0 H 0 T T 0, where P 0 = ( H 0 T H 0 ) 1 and K 0 P 0 1 = H 0 T H 0.

Step 4

Set k = 0, where k is a parameter indicating the number of chunks of data that are presented to the network.

Sequential learning phase: present the (k + 1)-th chunk of new observations N k + 1 = { ( x i , t i ) } i = ( j = 0 k N j ) + 1 j = 0 k + 1 N j, where Nk+1 denotes the number of observations in the (k + 1)-th chunk.

Step 1

Compute the partial hidden layer output matrix Hk+1 =

[ G ( a 1 , b 1 , x ( j = 0 k N j ) + 1 ) G ( a L , b L , x ( j = 0 k N j ) + 1 ) G ( a 1 , b 1 , x j = 0 k + 1 N j ) G ( a L , b L , x j = 0 k + 1 N j ) ] N k + 1 × L

Step 2

Calculate the output weight β(k+1). We have T k + 1 = [ t ( j = 0 k N j ) + 1 , , t j = 0 k + 1 N j ] N k + 1 × m T. Moreover,

K k + 1 = K k + H k + 1 T H k + 1
β ( k + 1 ) = β ( k ) + K k + 1 1 H k + 1 T ( T k + 1 H k + 1 β ( k ) )

In order to avoid inverting matrices, such as K k + 1 1 in Equation (5) in the recursive process, the Woodbury formula [30] is applied to transform the equations as follows:

K k + 1 1 = K k 1 K k 1 H k + 1 T ( I + H k + 1 K k 1 H k + 1 T ) 1 H k + 1 K k 1
Since P k + 1 = K k + 1 1,
P k + 1 = P k P k H k + 1 T ( I + H k + 1 P k H k + 1 T ) 1 H k + 1 P k
β ( k + 1 ) = β ( k ) + P k + 1 H k + 1 T ( T k + 1 H k + 1 β ( k ) )

Step 3

Set k = k + 1. Go to Step 2 in this online sequential learning phase.

3.2. OS-ELM-Based Indoor Localization Algorithm

The proposed OS-ELM approach considers the localization problem as a regression problem. For WiFi RSS fingerprint calibration process, OS-ELM only requires a relative sparse radio map of WiFi RSS during the offline phase, which trumps the traditional fingerprinting-based localization algorithms. These WiFi RSS fingerprints and their physical locations are adopted as training inputs and training targets, respectively, to build up an initial OS-ELM model for online localization.

Furthermore, by leveraging the online learning ability of OS-ELM, WiFi RSS fingerprints can also be collected at some known locations during the online phase to reflect the environmental dynamics. Once new WiFi RSS fingerprints have been collected, they will be integrated into the initial OS-ELM model to update and generate a revised OS-ELM model. During the online phase, when a user sends a location request with his or her current WiFi RSS fingerprint, the fingerprint will be fed into the latest revised OS-ELM model, and then, the estimated location will be calculated.

The methodology and framework of the proposed OS-ELM approach are demonstrated in Figure 1. The processes of the three main phases of the OS-ELM approach are presented as follow:

3.2.1. Offline Calibration Phase

Suppose Sensors 15 01804i10 WiFi RSS fingerprints are collected at some known locations during the offline calibration phase. These WiFi RSS fingerprints and their corresponding physical locations are adopted as the training inputs x and the training targets t, respectively, for OS-ELM offline training. Similar to the initialization phase of OS-ELM, the initial OS-ELM model will be trained as mentioned in Section 3.1. The detailed steps are illustrated below:

Step 1

Randomly assign the input parameters: input weights ai and input bias bi.

Step 2

Calculate the initial hidden layer output matrix H0.

Step 3

Estimate the initial output weight β(0).

Step 4

Set k = 0, where k indicates the number of updating times of WiFi RSS fingerprints that are collected during the online calibration phase.

Additionally, the activation function G and the number of hidden nodes L need to be carefully tuned in order to guarantee that the initial OS-ELM model can provide sufficient localization accuracy for the users before any WiFi RSS fingerprints are collected at any online calibration points during the online phase. The five-fold cross-validation method with a range from zero to 1000 and a step size of 50 is employed to select the optimal number of hidden nodes L. A guideline for selecting the type of activation functions and the number of hidden nodes is presented in Section 5.

3.2.2. Online Sequential Learning Phase

The main purpose of the online sequential learning phase of OS-ELM is to make the localization algorithm more robust and be able to adapt to various environmental changes. Unlike other online sequential learning algorithms, which can only handle data one-by-one, OS-ELM can learn data one-by-one or chunk-by-chunk with a varying chunk size.

Therefore, WiFi RSS fingerprints can be collected and updated more flexibly for OS-ELM online sequential learning. These newly collected WiFi RSS fingerprints and their corresponding physical locations will be adopted as training samples, and they will be updated chunk-by-chunk to revise the initial OS-ELM model during the online sequential learning phase. Suppose Sensors 15 01804i1k+1 WiFi RSS fingerprints have been collected during the (k + 1)-th online calibration; the revised OS-ELM model will be obtained by the following steps:

Step 1

Calculate the partial hidden layer output matrix Hk+1.

Step 2

Calculate the output weight β(k+1).

Step 3

Set k = k + 1 for the next online calibration.

3.2.3. Online Localization Phase

Before any WiFi RSS fingerprints are collected at any known locations during the online phase, the initial OS-ELM model will be used to provide estimated locations of users when they send location queries with their real-time WiFi RSS fingerprints.

When more WiFi RSS fingerprints are collected at some known locations during the online calibration phase, the OS-ELM model is updated and revised. It will be used to provide the estimated location of the user.

4. Simulation Results and Evaluation

We develop a simulation environment using MATLAB R2013a in order to evaluate the performance of the proposed OS-ELM approach before any experiment is conducted. The simulation is running on a PC, which has a Intel Core i5-2400 3.10-GHz CPU and 8 GB RAM. As shown in Figure 2, we assume a 20 m × 20 m room, where four WiFi access points are installed at the four corners of the room. The most commonly-used path loss model for indoor environment is the International Telecommunication Union (ITU) indoor propagation model [31]. Since it provides a relation between the total path loss PL (dBm) and distance d (m), it is adopted to simulate the WiFi signals generated from each WiFi access point. The indoor path loss model can be expressed as:

P L ( d ) = P L 0 10 α log ( d ) + X σ
where PL0 is the pass loss coefficient, and it is set to be −40 dBm in our simulation. Xσ represents a zero-mean normal random noise with standard deviation σ = 0.5, and α is the path loss exponent.

During the offline calibration phase, α is set to be two in Scenario I, and simulated WiFi RSS fingerprints from the four WiFi routers are collected at 10 randomly selected offline calibration points for OS-ELM offline training, with 200 WiFi RSS fingerprints collected at each point. The hardlim function G(a, b, x) = hardlim(ax + b) is chosen as the activation function, and 380 hidden nodes are selected and put in the hidden layer during the offline training. The initial OS-ELM model is obtained after a 0.219-s training process. In order to imitate the environmental dynamics in the room, we set α to be 2.5 in Scenario II and 3.5 in Scenario III, respectively. WiFi RSS fingerprints are collected at five online calibration points and five online testing points under each scenario. Two hundred WiFi RSS fingerprints are collected at each point, and the positions of these points are distinct. The positions of the offline calibration points, the online calibration points and the online testing points are demonstrated in Figure 2. The updated WiFi RSS fingerprints at the online calibration points are adopted as online training samples and leveraged to revise the initial OS-ELM model.

We evaluate the performance of OS-ELM with each online sequential learning updated based on the WiFi RSS fingerprints collected at the 10 online testing points. The distance error is used to measure the localization accuracy of the proposed OS-ELM approach. We define the location estimation error e to be the distance between the real location coordinates (x0, y0) and the system estimated location coordinates (x,y), i.e.,:

e = ( x x 0 ) 2 + ( y y 0 ) 2

Table 1 illustrates the performance of OS-ELM with each online sequential learning update in terms of training time, testing time and average localization accuracy. The comparison of the cumulative percentile of error distances between the initial OS-ELM and the two updated OS-ELM is presented in Figure 3. It can be easily spotted from Table 1 that the average localization accuracy of OS-ELM becomes better when more WiFi RSS fingerprints at various online calibration points have been learned online. The latest updated OS-ELM can provide 1.794 m, which enhances the precision of indoor localization by 42.18% over the performance of the initial OS-ELM. Furthermore, the online sequential learning of OS-ELM is very efficient. It only spends 0.014 s on average to calculate the output weights β for 1000 newly-received WiFi RSS fingerprints in each online sequential learning update.

Based on the simulation results and evaluation, we can conclude that OS-ELM can provide higher localization accuracy due to its efficient online sequential learning ability when the indoor environment is altered during the online phase.

5. Experimental Results and Performance Evaluation

5.1. System Overview

We conducted extensive experiments to evaluate the performance of the proposed OS-ELM approach. The testbed is Internet of Things Laboratory at School of Electrical and Electronic Engineering, Nanyang Technological University. The area of the test-bed is around 580 m2 (35.1 m × 16.6 m). Thirty six graduate students and 15 undergraduate students work and study in this lab regularly.

The layout of the testbed is shown in Figure 4. Eight D-Link DIR-605L WiFi Cloud Routers are utilized as WiFi access points for our experiments. In order to collect WiFi RSS fingerprints from multiple access points simultaneously, an Android application that can collect data once per second is developed. As shown in Figure 5, this Android app is installed on a Samsung I929 Galaxy SII mobile phone. We leveraged this mobile phone to collect the WiFi RSS fingerprints at the offline calibration points, online calibration points and online testing points. After that, all of this information was sent to a process server running on a PC. The performance evaluation was conducted on the server side.

The initial OS-ELM model was built by the following steps. During the offline phase, 30 offline calibration points were selected, and 1000 WiFi RSS fingerprints were collected at each point. The positions of these 30 offline calibration points are demonstrated in Figure 4. The grid spacing between two adjacent locations of the calibration points was chosen to be larger than 1.25 m based on the analysis in [32]. By leveraging these 30,000 WiFi RSS fingerprints and their physical positions as training inputs and training targets accordingly, the initial OS-ELM model was constructed. During the online phase, we continued to collect WiFi RSS fingerprints at several online calibration points and online testing points for five days. In each day, two distinct online calibration points and two distinct online testing points were selected in order to reflect the environmental dynamics. The positions of these total 10 online calibration points and 10 online testing points are also presented in Figure 4. One thousand WiFi RSS fingerprints are collected at each point. Unlike [18], which only tested the performance of OS-ELM in the corridors in the testbed, as shown in Figure 4, the positions of the online calibration points and online testing points were selected on the tables and cubicles, as well as in the testbed to acquire a more comprehensive performance evaluation of the proposed OS-ELM approach.

5.2. Selection of Parameters for the Initial OS-ELM Model

Based on the analysis in Section 3.2, the type of activation function and the number of hidden nodes in the OS-ELM hidden layer are two key parameters affecting the performance of OS-ELM during the initialization phase, which is accordingly the offline calibration phase in our case.

5.2.1. Selection of the Type of Activation Function G for the Initial OS-ELM Model

By using the 30,000 WiFi RSS fingerprints we collected during the offline calibration phase, we evaluate the performance of three different activation functions: radial basis function (RBF) G(a, b, x) = e−bx−a‖2, sine function G(a, b, x) = sin(ax+b) and hard-limit transfer (hardlim) function G(a, b,x) = hardlim(ax + b), with different numbers of hidden nodes.

It can be seen from Figure 6 that as the number of hidden nodes increases, the performances in terms of the mean localization accuracy of the sine function and hardlim function become better. On the contrary, the performance of RBF is the worst and appears to be irrelevant with respect to the number of hidden nodes. Since the performance of the hardlim function is the best among the three activation functions, it is chosen as the activation function for the initial OS-ELM model and also for the online sequential learning of OS-ELM.

5.2.2. Selection of the Number of Hidden Nodes L for the Initial OS-ELM Model

Another critical parameter for the performance of the OS-ELM approach is the number of hidden nodes L in the initial OS-ELM hidden layer, after the hardlim function is chosen as the activation function. The five-fold cross-validation method is employed with a range from 0 to 1000 and a step size of 50 in order to determine the optimal L. As observed in Figure 6, the performances in terms of the localization accuracy of the hardlim function become relatively stable when L is increased to 600.

In addition to the evaluation of the localization accuracy, the repeatability (REP) of the initial OS-ELM with a different number of hidden nodes is also evaluated by leveraging the 30,000 WiFi RSS fingerprints that we collected during the offline calibration phase. REP is measured by the standard deviation of localization errors over the r repeated realizations, and this measure is proposed based on the fact that ELM with the same parameters and in the same training dataset may draw quite different results. A smaller value of REP is desired in general. The mean localization error and REP are calculated based on the following equations:

e ¯ = 1 r m = 1 r e m
REP = 1 r m = 1 r ( e m e ¯ )

r in our experiment is selected as 50. Figure 7 demonstrates the repeatability of the initial OS-ELM, which is measured by the standard deviation of localization error with a range of hidden nodes from zero to 1000 and a step size of 50. As observed from Figure 7, the standard deviation of localization errors decreases when the number of hidden nodes is increased. After comprehensive evaluations on both localization accuracy and repeatability, L is selected to be 950.

A guideline for selecting the type of activation function and the number of hidden nodes in the OS-ELM hidden layer, both of which are the critical parameters for the performance of the OS-ELM approach, is listed as follows: the suggested default activation function for the OS-ELM approach is the hardlim function, whose performance is better than others generally in terms of simulation and experimental results. As for the optimal number of hidden nodes, the five-fold cross-validation method is employed with a range from 0 to 1000 and a step size of 50 based on the empirical tuning.

5.3. Comparison between OS-ELM and Other Methods

Three well-known algorithms, RADAR K nearest neighbor (KNN) [7], fuzzy K nearest neighbor (Fuzzy KNN) [33] and batch ELM [14], are chosen to compare with the proposed OS-ELM approach. It has been shown in [34,35] that the performance of batch ELM in terms of the offline training time, the online testing time and the average localization accuracy is better than classical machine learning algorithms, such as the back-propagation (BP) algorithm and the support vector machine for regression (SVR) algorithm. Therefore, we choose batch ELM to be compared with the proposed OS-ELM. Considering the wide usage of KNN and fuzzy KNN as classical localization algorithms, we also include them in the comparison.

Unlike OS-ELM, which can update and revise the initial OS-ELM model sequentially during the online phase, KNN, fuzzy KNN and batch ELM can only utilize the data collected during the offline phase. In order to make a fair comparison, we collected WiFi RSS fingerprints, not only at the 30 offline calibration points, but also at the 10 online calibration points, to build up the WiFi RSS fingerprints offline database during the offline calibration phase. One thousand WiFi RSS fingerprints were collected at each point. The hardlim function and 950 hidden nodes in the hidden layer were chosen for batch ELM offline training, which are the same as for the initial OS-ELM offline training. The batch ELM model was obtained by leveraging the WiFi RSS fingerprints and their corresponding locations stored in the database. During the online phase, after feeding the WiFi RSS fingerprints into the batch ELM model, this model will output the estimated location of the target. For KNN and fuzzy KNN, the value of K was chosen empirically based on the data stored in the database. During the online phase, by matching the measured WiFi RSS fingerprints with the K closest WiFi RSS fingerprints in the database, the location of the target will be calculated. The detail methodologies of these are presented in [7,33].

The comparison of performances will be conducted as follows. First of all, we evaluate the performances of KNN, fuzzy KNN, batch ELM and OS-ELM without online sequential learning based on the WiFi RSS fingerprints we collected at the 10 online testing points during the online localization phase. Table 2 demonstrates the performance comparison between KNN, fuzzy KNN, batch ELM and OS-ELM in terms of the training time, the testing time and the average localization accuracy. As shown in Table 2, although the localization accuracy of the initial OS-ELM is slightly worse than that of batch ELM, the offline training time of OS-ELM is less than that of batch ELM by 30.01%, which evidently reduces the time and manpower costs for the offline site survey. The testing times of KNN, fuzzy KNN, batch ELM and OS-ELM are almost the same.

During the online phase, since we collected WiFi RSS fingerprints at two different online calibration points at each time, the performance of OS-ELM with each online sequential learning update is also presented in Table 2. As observed from Table 2, the average localization accuracy of OS-ELM becomes better when more WiFi RSS fingerprints at different online calibration points have been learned online. In addition, another noteworthy point is that the online sequential learning time of OS-ELM is quite fast. It only spends 1.2108 s on average to calculate the output weights β for 2000 newly-received WiFi RSS fingerprints in each online sequential learning update.

As observed from Table 2, the average localization accuracy by using KNN, fuzzy KNN and batch ELM is, respectively, 3.098 m, 2.728 m and 2.581 m. In contrast, with online sequential learning of WiFi RSS fingerprints at 10 different online calibration points, OS-ELM can provide a localization accuracy of 1.973 m, which enhances the precision of indoor localization by 36.31%, 27.68% and 23.56% over KNN, fuzzy KNN and batch ELM, respectively. The comparison of the cumulative percentile of error distances between KNN, fuzzy KNN, batch ELM and the latest updated OS-ELM is presented in Figure 8. Figure 9 demonstrates the distance error distribution of the four approaches. The distance error distribution of OS-ELM, as shown in Figure 9d, ranges mainly within 2.5 m. On the contrary, the distance error distributions of KNN in Figure 9a, fuzzy KNN in Figure 9b and batch ELM in Figure 9c are much more scattered.

In summary, based on our experimental results and analysis, we can conclude that OS-ELM can provide higher localization accuracy consistently with a fast online sequential learning speed to adjust to various environmental dynamics than existing approaches, such as KNN, fuzzy KNN and batch ELM.

5.4. Performance Evaluation of OS-ELM under Specific Environmental Dynamics

Variations of occupancy distribution and events of opening and closing of doors have been observed as two major environmental factors that could severely affect the localization accuracy of WiFi-based IPS, since they change frequently over time in the indoor environment [6]. Besides the general performance evaluation of the proposed OS-ELM approach, as shown in [18] and the above sections, we also conducted experiments to evaluate how well OS-ELM adapts to some specific environmental dynamics. During each experiment, we measured the localization accuracy of the system when only one environmental factor was altered, while others remained unvaried.

5.4.1. Impact of Human Presence and Movements

This experiment aims to determine how well the proposed OS-ELM approach can adjust to the interferences of human presence and movements while other environmental factors are kept unchanged. The experiment was conducted in the conference room in the testbed, since it is easier to create and manage the variation of the occupancy distribution for performance evaluation in this relatively small space. As shown in Figure 1, the location of the conference room is the left upper corner of the testbed. The area of the conference room is around 22 m2 (6.3 m × 3.5 m).

The experiment was conducted based on the following steps. First of all, we continued to collect WiFi RSS fingerprints at five offline calibration points for one day when nobody was in the conference room. After that, the batch ELM model and the initial OS-ELM model were built up based on the collected WiFi RSS fingerprints and their corresponding positions. We put the testing mobile device on the conference table to evaluate the performances of the batch ELM and the OS-ELM under the non-human interference condition in the first place. As shown in Table 3, the batch ELM and the OS-ELM provide similar localization accuracy under the non-human interference condition, which is 2.203 m and 2.183 m, respectively.

Then, we evaluate the performance of both batch ELM and OS-ELM with human interference. The position of the online testing point was unchanged. However, five people intentionally sat around the table for 6 h. The purpose is to use human bodies to disturb or block the WiFi signal transmission between the test mobile device and the multiple WiFi access points. Meanwhile, WiFi RSS fingerprints were collected at three online calibration points to update and revise the OS-ELM model.

After conducting the experiment for 6 h, the average localization accuracies of the two approaches are calculated and demonstrated in Table 3. It can be seen from Table 3 that the performance of batch ELM becomes worse with human interference. Its performance decay is 41.99% compared with non-human interference. The main reason is that the batch ELM model was constructed under non-human interference, which cannot reflect the variation of occupancy distribution adaptively during the online phase. On the contrary, by leveraging the information collected at the online calibration points, OS-ELM can nicely capture the event of human presence and movements and take this environmental change into the online localization process sequentially. As shown in Table 3, the average localization accuracy provided by OS-ELM under the human interference circumstance is 2.197 m, almost the same as the non-human interference scenario. It enhances the precision of indoor localization by 29.27% over batch ELM under the same condition.

To conclude, OS-ELM can provide high localization accuracy consistently when the occupancy distribution is altered due to its fast adaptation.

5.4.2. Impact of Opening/Closing of Doors

Besides the variation of occupancy distribution, another environmental factor that affects the performance of WiFi-based IPS badly is the events of opening and closing of doors. Therefore, we also conducted an experiment to evaluate how well the proposed OS-ELM approach can adjust to opening and closing of doors while other environmental factors were kept unchanged.

The experiment was conducted based on the following steps. We collected WiFi RSS fingerprints at 15 offline calibration points, which were near the four doors inside the testbed for one day under the all-door-open condition firstly. The batch ELM model and the initial OS-ELM model were built up by leveraging the collected WiFi RSS fingerprints and their corresponding positions. Then, we determined the performance of these two approaches near the door area. It can be seen from Table 4 that both batch ELM and OS-ELM can provide nearly 2.15-m localization accuracy on average when all doors are opened.

After that, we continued the experiment to assess the performance of these two approaches under the all-door-close condition. We closed the four doors within the testbed for 6 h and collected WiFi RSS fingerprints at the same online testing points as under the all-door-open condition. WiFi RSS fingerprints were also collected at the 10 online calibration points in the testbed simultaneously for updating the OS-ELM model.

The average localization accuracy of batch ELM and OS-ELM under the all-door-close condition is presented in Table 4. As shown in Table 4, the average localization accuracy of batch ELM is 4.203 m when all doors are closed, which is 47.32% worse than the all-door-open condition. This reveals that batch ELM is not capable of providing a sufficient and satisfactory indoor positioning service when the status of doors is different from the offline calibration phase.

In contrast, the performance of OS-ELM is more stable and robust when the status of doors is altered. It can be seen in Table 4 that the average localization accuracy provided by OS-ELM under the all-door-close condition is 2.085 m, which is roughly the same as the all-door-open condition. Moreover, it enhances the precision of indoor localization by 50.39% over batch ELM. The main reason that OS-ELM can consistently provide the indoor positioning service under different status of doors is due to its online sequential learning ability. By leveraging the information collected at the online calibration points, OS-ELM can sequentially update its model to adjust the influence from opening or closing doors.

Thus, the experimental results leads to the same conclusion that OS-ELM can provide higher localization accuracy steadily under various environmental dynamics, regardless of the impact from human presence or movements or the influence from changing the status of doors.

6. Conclusions and Future Work

In this paper, we proposed an indoor localization algorithm based on OS-ELM to address the two challenging problems of the existing WiFi-based IPS: the intensive costs of manpower and time for offline site survey and the inflexibility to environmental dynamics. Both our simulation analysis and experimental studies have shown that OS-ELM can tackle the problems satisfactorily. The fast learning speed of OS-ELM obviously reduced the time consumptions and manpower costs for the site survey during the offline calibration phase. In addition, the online sequential learning ability of OS-ELM made it possible to reflect and adapt to the environmental changes in a timely manner. Furthermore, WiFi RSS fingerprints can be collected and updated more flexibly, since OS-ELM can learn data with a varying chunk size. Experiments under specific environmental dynamics, such as variations of the occupancy distribution and events of opening or closing doors, were also conducted. In summary, OS-ELM can provide high localization accuracy with a fast online sequential learning speed under various environmental changes and achieve superior performance to the existing approaches.

Future work can be focused on the following directions. Firstly, since we only conducted experiments in the lab environment, experiments in other indoor scenarios, such as lecture theaters or shopping centers, need to be conducted to make the performance evaluation of OS-ELM more conclusive. Secondly, mobile devices with different brands or equipped with different WiFi chipsets as the one used in the experiments will incur degraded localization accuracy. Therefore, how to improve OS-ELM to overcome the heterogeneous issue among mobile devices is quite attractive.

Acknowledgments

This research is partially funded by the Republic of Singapore National Research Foundation through a grant to the Berkeley Education Alliance for Research in Singapore (BEARS) for the Singapore-Berkeley Building Efficiency and Sustainability in the Tropics (SinBerBEST) Program. BEARS has been established by the University of California, Berkeley, as a center for intellectual excellence in research and education in Singapore.

This research is also partially funded by the Republic of Singapore National Research Foundation through grants: NRF2011NRF-CRP001-090, NRF2013EWT-EIRP004-012 and NSFC NSFC 61120106011.

Author Contributions

Han Zou proposed the OS-ELM-based localization algorithm and expanded the conference version to a journal version. Han Zou and Xiaoxuan Lu conducted the simulation and experiments. Hao Jiang developed the Android app for the experiment. Lihua Xie supervised the work and revised the paper.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Buchli, B.; Sutton, F.; Beutel, J. Gps-equipped wireless sensor network node for high-accuracy positioning applications. In Wireless Sensor Networks; Springer: Trento, Italy, 2012; pp. 179–195. [Google Scholar]
  2. Liu, H.; Darabi, H.; Banerjee, P.; Liu, J. Survey of wireless indoor positioning techniques and systems. IEEE Trans Syst. Man Cybern. Part C Appl. Rev 2007, 37, 1067–1080. [Google Scholar]
  3. Gu, Y.; Lo, A.; Niemegeers, I. A survey of indoor positioning systems for wireless personal networks. IEEE Commu. Surv. Tutor 2009, 11, 13–32. [Google Scholar]
  4. Lloret, J.; Tomas, J.; Garcia, M.; Canovas, A. A hybrid stochastic approach for self-location of wireless sensors in indoor environments. Sensors 2009, 9, 3695–3712. [Google Scholar]
  5. Medina, C.; Segura, J.C.; de la Torre, A. Ultrasound indoor positioning system based on a low-power wireless sensor network providing sub-centimeter accuracy. Sensors 2013, 13, 3501–3526. [Google Scholar]
  6. Chen, Y.-C.; Chiang, J.-R.; Chu, H.-H.; Huang, P.; Tsui, A.W. Sensor-assisted Wi-Fi indoor location system for adapting to environmental dynamics. Proceedings of the 8th ACM International Symposium on Modeling, Analysis and Simulation of Wireless and Mobile Systems, Montreal, QC, Canada, 10–13 October 2005; pp. 118–125.
  7. Bahl, P.; Padmanabhan, V.N. Radar: An in-building RF-based user location and tracking system, INFOCOM 2000. Proceedings of the Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies, Tel Aviv, Israel, 26–30 March 2000; pp. 775–784.
  8. Youssef, M.; Agrawala, A. The Horus WLAN location determination system. Proceedings of the 3rd International Conference on Mobile Systems, Applications, and Services, Seattle, WA, USA, 6–8 June 2005; pp. 205–218.
  9. Fox, D.; Hightower, J.; Liao, L.; Schulz, D.; Borriello, G. Bayesian filtering for location estimation. IEEE Pervasive Comput 2003, 2, 24–33. [Google Scholar]
  10. Brunato, M.; Battiti, R. Statistical learning theory for location fingerprinting in wireless LANs. Comput. Netw 2005, 47, 825–845. [Google Scholar]
  11. Chen, L.; Li, B.; Zhao, K.; Rizos, C.; Zheng, Z. An improved algorithm to generate a Wi-Fi fingerprint database for indoor positioning. Sensors 2013, 13, 11085–11096. [Google Scholar]
  12. Liu, J.; Chen, R.; Pei, L.; Guinness, R.; Kuusniemi, H. A hybrid smartphone indoor positioning solution for mobile lbs. Sensors 2012, 12, 17208–17233. [Google Scholar]
  13. Wu, C.; Yang, Z.; Liu, Y.; Xi, W. WILL: Wireless indoor localization without site survey. IEEE Trans. Parallel Distrib. Syst 2013, 24, 839–848. [Google Scholar]
  14. Huang, G.-B.; Zhu, Q.-Y.; Siew, C.-K. Extreme learning machine: Theory and applications. Neurocomputing 2006, 70, 489–501. [Google Scholar]
  15. Liang, N.-Y.; Huang, G.-B.; Saratchandran, P.; Sundararajan, N. A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans. Neural Netw 2006, 17, 1411–1423. [Google Scholar]
  16. LeCun, Y.; Bottou, L.; Orr, G.; Muller, K.-R. Efficient Backprop; Neural Networks: Tricks of the Trade; Springer: Berlin, Heidelberg, Germany, 1998. [Google Scholar]
  17. Huang, G.-B.; Saratchandran, P.; Sundararajan, N. An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks. IEEE Trans. Syst. Man Cybern. B Cybern 2004, 34, 2284–2292. [Google Scholar]
  18. Zou, H.; Jiang, H.; Lu, X.; Xie, L. An online sequential extreme learning machine approach to WiFi based indoor positioning. Proceedings of the 2014 IEEE World Forum on Internet of Things (WF-IoT), Seoul, Korea, 6–8 March 2014; pp. 111–116.
  19. Youssef, M.; Youssef, A.; Rieger, C.; Shankar, U.; Agrawala, A. Pinpoint: An asynchronous time-based location determination system. Proceedings of the 4th International Conference on Mobile Systems, Applications and Services, Uppsala, Sweden, 19–22 June 2006; pp. 165–176.
  20. Priyantha, N.B.; Chakraborty, A.; Balakrishnan, H. The cricket location-support system. Proceedings of the 6th Annual International Conference on Mobile Computing and Networking, Boston, MA, USA, 6–11 August 2000; pp. 32–43.
  21. Chintalapudi, K.; Padmanabha Iyer, A.; Padmanabhan, V.N. Indoor localization without the pain. Proceedings of the Sixteenth Annual International Conference on Mobile Computing and Networking, Chicago, IL, USA, 20–24 September 2010; pp. 173–184.
  22. Lim, H.; Kung, L.-C.; Hou, J.C.; Luo, H. Zero-configuration indoor localization over IEEE 802.11 wireless infrastructure. Wirel. Netw 2010, 16, 405–420. [Google Scholar]
  23. Turner, D.; Savage, S.; Snoeren, A.C. On the empirical performance of self-calibrating wifi location systems. Proceedings of the 36th Conference on Local Computer Networks (LCN), Bonn, Germany, 4–7 October 2011; pp. 76–84.
  24. Zou, H.; Wang, H.; Xie, L.; Jia, Q.-S. An RFID indoor positioning system by using weighted path loss and extreme learning machine. Proceedings of the 1st International Conference on Cyber-Physical Systems, Networks, and Applications (CPSNA), Taipei, China, 1–20 August 2013; pp. 66–71.
  25. Ni, L.M.; Liu, Y.; Lau, Y.C.; Patil, A.P. Landmarc: Indoor location sensing using active RFID. Wirel. Netw 2004, 10, 701–710. [Google Scholar]
  26. Matic, A.; Papliatseyeu, A.; Osmani, V.; Mayora-Ibarra, O. Tuning to your position: Fm radio based indoor localization with spontaneous recalibration, Pervasive Computing and Communications (PerCom). 2010 IEEE International Conference on, Mannheim, Germany, 29 March–10 April 2010; pp. 153–161.
  27. Chung, J.; Donahoe, M.; Schmandt, C.; Kim, I.-J.; Razavai, P.; Wiseman, M. Indoor location sensing using geo-magnetism. Proceedings of the 9th International Conference on Mobile Systems, Applications, and Services, Washington, DC, USA, 28 June–1 July 2011; pp. 141–154.
  28. Galván-Tejada, C.E.; García-Vázquez, J.P.; Brena, R.F. Magnetic field feature extraction and selection for indoor location estimation. Sensors 2014, 14, 11001–11015. [Google Scholar]
  29. Varshavsky, A.; de Lara, E.; Hightower, J.; LaMarca, A.; Otsason, V. Gsm indoor localization. Pervasive and Mob. Comput 2007, 3, 698–720. [Google Scholar]
  30. Golub, G.H.; van Loan, C.F. Matrix Computations (Johns Hopkins Studies in Mathematical Sciences); Johns Hopkins University Press: Baltimore, MD, USA, 1996. [Google Scholar]
  31. Chrysikos, T.; Georgopoulos, G.; Kotsopoulos, S. Site-specific validation of ITU indoor path loss model at 2.4 GHz. Proceedings of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks and Workshops, Kos, Greece, 15–19 June 2009; pp. 1–6.
  32. Kaemarungsi, K.; Krishnamurthy, P. Analysis of WLAN's received signal strength indication for indoor location fingerprinting. Pervasive Mob. Comput 2012, 8, 292–316. [Google Scholar]
  33. Keller, J.M.; Gray, M.R.; Givens, J.A. A fuzzy k-nearest neighbor algorithm. IEEE Trans. Syst. Man Cybern. B Cybern 1985, 4, 580–585. [Google Scholar]
  34. Zou, H.; Xie, L.; Jia, Q.-S.; Wang, H. An integrative weighted path loss and extreme learning machine approach to rfid based indoor positioning. Proceedings of the 4th IEEE International Conference on Indoor Positioning and Indoor Navigation (IPIN 2013), Montbeliard-Belfort, France, 28–31 October 2013; pp. 1–5.
  35. Zou, H.; Xie, L.; Jia, Q.-S.; Wang, H. Platform and algorithm development for a RFID-based indoor positioning system. Unmanned Syst 2014, 2, 279–291. [Google Scholar]
Figure 1. Methodology of the online sequential extreme learning machine (OS-ELM) approach.
Figure 1. Methodology of the online sequential extreme learning machine (OS-ELM) approach.
Sensors 15 01804f1 1024
Figure 2. Positions of the WiFi access points, offline calibration points, online calibration points and online testing points in the simulated field.
Figure 2. Positions of the WiFi access points, offline calibration points, online calibration points and online testing points in the simulated field.
Sensors 15 01804f2 1024
Figure 3. Cumulative percentile of error distance.
Figure 3. Cumulative percentile of error distance.
Sensors 15 01804f3 1024
Figure 4. Positions of the WiFi access points, offline calibration points, online calibration points and online testing points in the test-bed.
Figure 4. Positions of the WiFi access points, offline calibration points, online calibration points and online testing points in the test-bed.
Sensors 15 01804f4 1024
Figure 5. The test mobile device Samsung I929 and developed Android apps.
Figure 5. The test mobile device Samsung I929 and developed Android apps.
Sensors 15 01804f5 1024
Figure 6. Localization accuracy regarding different activation functions and different numbers of hidden nodes.
Figure 6. Localization accuracy regarding different activation functions and different numbers of hidden nodes.
Sensors 15 01804f6 1024
Figure 7. Deviation of distance error with different numbers of hidden nodes.
Figure 7. Deviation of distance error with different numbers of hidden nodes.
Sensors 15 01804f7 1024
Figure 8. Cumulative percentile of error distance for different methods.
Figure 8. Cumulative percentile of error distance for different methods.
Sensors 15 01804f8 1024
Figure 9. Comparison of the distance error distribution for different methods. (a) KNN; (b) fuzzy KNN; (c) batch ELM; (d) OS-ELM.
Figure 9. Comparison of the distance error distribution for different methods. (a) KNN; (b) fuzzy KNN; (c) batch ELM; (d) OS-ELM.
Sensors 15 01804f9 1024
Table 1. Simulation results of OS-ELM.
Table 1. Simulation results of OS-ELM.
Number of Calibration Points (Offline + Online)Training Time (s)Testing Time (s)Accuracy (m)
10 + 00.2190.0153.103
10 + 50.1480.0142.563
15 + 50.1390.0141.794
Table 2. Comparison between OS-ELM and other methods.
Table 2. Comparison between OS-ELM and other methods.
ApproachesNumber of Calibration Points (Offline + Online)Training Time (s)Testing Time (s)Accuracy (m)
KNN40 + 0-0.1083.098

Fuzzy KNN40 + 0-0.1172.728

Batch ELM40 + 011.5740.1132.581

OS-ELM30 + 08.1010.1132.615
30 + 21.2040.1112.487
32 + 21.2130.1142.346
34 + 21.1820.1092.219
36 + 21.2260.1152.091
38 + 21.2290.1171.973
Table 3. Impact of human presence and movements on localization accuracy.
Table 3. Impact of human presence and movements on localization accuracy.
Localization Accuracy (m)Non-Human InterferenceWith Human Interference
Batch ELM2.2033.106
OS-ELM2.1832.197
Table 4. Impact of opening/closing doors on localization accuracy.
Table 4. Impact of opening/closing doors on localization accuracy.
Localization Accuracy (m)All Doors are OpenedAll Doors are Closed
Batch ELM2.2144.203
OS-ELM2.1072.085

Share and Cite

MDPI and ACS Style

Zou, H.; Lu, X.; Jiang, H.; Xie, L. A Fast and Precise Indoor Localization Algorithm Based on an Online Sequential Extreme Learning Machine. Sensors 2015, 15, 1804-1824. https://doi.org/10.3390/s150101804

AMA Style

Zou H, Lu X, Jiang H, Xie L. A Fast and Precise Indoor Localization Algorithm Based on an Online Sequential Extreme Learning Machine. Sensors. 2015; 15(1):1804-1824. https://doi.org/10.3390/s150101804

Chicago/Turabian Style

Zou, Han, Xiaoxuan Lu, Hao Jiang, and Lihua Xie. 2015. "A Fast and Precise Indoor Localization Algorithm Based on an Online Sequential Extreme Learning Machine" Sensors 15, no. 1: 1804-1824. https://doi.org/10.3390/s150101804

Article Metrics

Back to TopTop