Next Article in Journal
Performance Evaluation of Knitted and Stitched Textile Strain Sensors
Previous Article in Journal
The Reliability and Validity of Wearable Inertial Sensors Coupled with the Microsoft Kinect to Measure Shoulder Range-of-Motion
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Exploring Fast Fingerprint Construction Algorithm for Unmodulated Visible Light Indoor Localization

1
School of Computer Science and Technology, China University of Mining and Technology, Xuzhou 221116, China
2
China Mine Digitization Engineering Research Center, Ministry of Education, Xuzhou 221116, China
*
Author to whom correspondence should be addressed.
Sensors 2020, 20(24), 7245; https://doi.org/10.3390/s20247245
Submission received: 12 November 2020 / Revised: 12 December 2020 / Accepted: 14 December 2020 / Published: 17 December 2020
(This article belongs to the Section Optical Sensors)

Abstract

:
The study of visible light indoor position has received considerable attention. The visible light indoor position has problems such as deployment difficulty and high cost. In our system, we propose a new fingerprint construction algorithm to simplify visible light indoor position. This method can realize the rapid construction of a visible fingerprint database and prove that the fingerprint database can be used repeatedly in different environments. We proved the theoretical feasibility of this method through theoretical derivation. We carried out extensive experiments in two classic real indoor environments. Experimental results show that reverse fingerprinting can be achieved. In 95% of cases, the positioning accuracy can be guaranteed to be less than 10 cm.

1. Introduction

The rapid development of the Internet of Things (IoTs) promotes the development of smart devices [1,2,3,4]. Indoor positioning greatly expands the capabilities of these devices and therefore attracts a great amount of research work. The global positioning system has limitations in indoor positioning [5,6,7,8], and researchers have proposed the use of Wireless Fidelity (Wi-Fi), ultra-wideband (UWB), ultrasonic wave, and visible light positioning (VLP) technologies [9,10,11,12,13]. However, the main problem with Wi-Fi signals is the multipath effect. Although both UWB and ultrasonic wave can provide submeter positioning accuracy (0.1 m), the high cost to deploy these systems is their main disadvantage [14,15,16,17,18,19].
Most visible light indoor positioning needs the support of visible light communication (VLC) technology [20,21,22,23,24]. VLC requires additional equipment to adjust the frequency of light, and most of them require photodiodes as the receiving end, which increases deployment costs [25,26,27,28]. Some scholars recently proposed visible light positioning (VLP) methods which do not need VLC support to match the visible light fingerprint dataset [9,29,30,31,32]. However, because the fingerprint database is affected by the environment, it takes a great amount of work to collect fingerprints frequently [33,34,35,36,37]. Therefore, the rapid establishment of fingerprint database has become the focus of this work. Fingerprint recognition is the main method of indoor visible light positioning [38,39,40,41,42,43]. Its disadvantage is that the process of fingerprint collection is cumbersome and high-cost for changing visible light fingerprints. Therefore, we proposed a simple fingerprint acquisition method to realize the low-cost VLP [44,45,46,47,48,49,50].
To address these issues, we explored a new fingerprint collection method and called it the reverse fingerprint collection method. Furthermore, we use this method for visible light indoor positioning, which does not need VLC support. Using ambient light or a headlamp, it can complete the position of a person (carrying a mobile phone that can shoot) and smart devices (with a camera). We study the principle of light reflection and the principle of light propagation in a straight line and derive a method to establish a fingerprint database in the entire indoor space quickly. This method lays a foundation for simplifying the fingerprint collection process. First, using the principle of color polarization of light, different interference patterns are obtained through polarizers and birefringent crystals. Then, we use the principle of straight-line propagation of light to quickly, and with low cost, construct the visible light positioning fingerprint of the entire space.
In the actual design of the reverse fingerprint method, we only need to use commercial white light or sunlight as the light source. We use low-priced polarizers and ordinary transparent tape with birefringence characteristics to make color polarizers. Each color polarizer costs no more than 10 cents. The color polarizing plate is attached in front of the light source; the interference pattern is projected on the white reflective plate. The interference pattern on the reflector is photographed and recorded, and a full-space positioning fingerprint library is obtained after image processing.
The specific objective of this study was to improve the unmodulated visible light position method [9]. This paper proposes a novel fingerprint collection method, which significantly simplifies the difficulty and workload of fingerprint collection in the visible light position system, and experimentally obtains how different relative positions of positioning originals will affect the positioning results.
The contributions of our work mainly include the following aspects:
  • We proposed a new reverse fingerprint collection method to realize the rapid collection and deployment of fingerprint information with the change of environment. In addition, through theory and practice, we prove the reusability of reverse-collected fingerprints in different environments;
  • We combine the theory of light propagation and image processing method for the first time, which significantly reduces the workload and time cost of constructing a visible light location fingerprint database. Meanwhile, the fingerprint library of the whole indoor environment can be obtained in a short time;
  • We conducted multiple sets of experiments and compared the impact of fingerprints collected in different environments on the positioning results. The reverse fingerprinting can be achieved. In 95% of cases, the positioning accuracy can be guaranteed to be less than 10 cm.
The organization of the remainder is as follows. Section 2 introduces related work. Section 3 presents position basics of our work. Section 4 presents the localization model of the reverse fingerprint collection method. Section 5 introduces experiment of the reverse fingerprint collection method. Section 6 presents the evaluation results of the reverse fingerprint collection method. Section 7 concludes this work.

2. Related Work

Most VLPs use VLC technology as support. Some of the representative works are as follows. In [4], the authors maximized the communication speed of VLC while implementing VLP and lighting functions. A VLP system based on VLC and a genetic algorithm was proposed by the authors of [12]. In [15], the authors combined the radio frequency signal and visible light signal to build a portable and movable hybrid measuring element and use it for underground positioning. The authors of [5] expanded the number of LEDs used for communication and positioning to four, and added a four-quadrant algorithm as an auxiliary receiving scheme. The authors of [17] improved the difference algorithm to be suitable for visible light signals and subsequently used it for positioning research. Due to the complex hardware changes of these algorithms, they are limited in daily applications. Therefore, it is necessary to explore visible light positioning methods that do not require hardware changes.
In [7], the authors combined machine learning with visible light and USES Angle of arrival for indoor targeting, and they ended up using quadrant solar cells as a way to increase progress. The literature [1] used improved reception devices, programmable beacons, and embedded positioning programs in smartphones to achieve simple and low-cost visible light indoor positioning. The authors of [6] proposed a grid sampling scheme in the location domain. In [21], they used the determinant of the cost function to derive a more accurate and accurate visible light indoor algorithm; however, no environmental comparison was made. In [8], the visible light indoor positioning system and its algorithm were systematically analyzed, and suggestions for future research directions were put forward, providing inspiration for our work. The authors of [25] improved the scheme of using smartphones as visible signal receivers, and based on this, a new VLP solution was proposed. The authors of [9] showed RainbowLight, a novel method of using optical principles and modifying them for indoor positioning. These methods mainly inspire us to explore the reverse fingerprint position method.

3. Position Basics

In this section, we show the basic principles of the position for our method. The position method uses the phenomenon of color polarization of light. When light passes through the color polarizer, it will present different colors in different positions. The phenomenon of color polarization consists of polarization and birefringence. The light path of color polarization is shown in Figure 1.

3.1. Polarization

A light wave is a transverse wave. Polarization is a phenomenon that occurs only with transverse waves (also the most obvious sign that they are different from longitudinal waves). Natural light and LED light in each polarization direction are random and irregular. As the light passes through the polarizer, the electric vector is hindered by the spatial distribution, thereby losing the symmetry of the light wave vibration direction. Therefore, in the process of light propagation, only one kind of vibration is included, and its vibration direction is always kept in the same plane. This kind of light is called linear polarization light. As shown in Figure 1, natural light passes through the polarizing plate P and becomes linearly polarized light having an amplitude A. The polarization direction of the polarized light is parallel to the transmission axis of the polarizer.

3.2. Birefringence

When light enters a birefringent crystal, to get an incident along the direction of the crystal’s optical axis, the speed of light propagation will also change due to the direction of light vibration. This phenomenon is known as birefringence. The incident light will be broken into two rays whose vibration directions are perpendicular to each other. The two rays have different propagation speeds and have different refractive indices. One follows the general law of refraction, called the ordinary ray (o-ray), between the two kinds of refracted light produced by birefringent crystals. The other does not follow the ordinary law of refraction and is called the extraordinary ray (e-ray). In crystals, the propagation speed of the o-ray is independent of the propagation direction and is constant. The propagation speed of an e-ray is a variable related to the direction of propagation. There is a particular direction inside the crystal, and the speed of the e-ray traveling in this direction is equal to the speed of the o-ray. Due to its anisotropic properties, plastic film has a phenomenon of birefringence when light passes through. They can be used in experiments to replace birefringent crystals.

3.3. Color Polarization

The two beams have the same frequency and the same polarization direction, and have a fixed phase difference, which fully meets the interference conditions, so interference will occur. As shown in Figure 1, when they are projected on the polarizer P 2 , two situations will occur: (1) L e and L o are projected to the same direction of P 2 . At this time, L e 2 and L o 2 interfere without any additional phase difference. (2) L e and L o are projected to the two directions of P 2 . The interference of L e 2 and L o 2 will produce an additional phase difference of π . Thus, linear polarized incident after polaroid and birefringence L e 2 and L o 2 phase caused by the part of the δ 1 and δ 2 . δ 1 is generated by the thickness as the birefringent crystal d, i.e., δ 1 is the reason for different colors. δ 2 with L e and L o projection onto the P 2 , if two lights are in the same direction, δ 2 = 0, otherwise δ 2 = π .

4. Reverse Fingerprint Position Method

In this section, we will first introduce the system principle of the reverse fingerprint collection method. Then, we will prove that, using this method, the fingerprint collected in one situation can be used for positioning in many different environments. The structural logic of the reverse fingerprint localization method is shown in Figure 2.

4.1. Reverse Fingerprint

As described in Section 3, after passing through the color polarizer, the wavelength value of the light will change, so the light will also have a different color. We use the principle of light reflection. When illuminating an object, the color of the object is determined by the light reflected or transmitted by the object, and the white opaque object reflects all colors of light. Therefore, if we put the color polarizer in front of the light source and place a white partition in front of the color polarizer, the white partition will reflect a unique polarization pattern. Since the light rays propagate in a straight line and the light path is reversible, taking any point on the white partition, the color of the light reflected at this point is the same as the color seen at the point where the color polarizer is taken. Therefore, the reflection pattern on the white partition can be photographed as the fingerprint pattern of the color polarizer. The method of using this pattern as fingerprint data for positioning is the reverse fingerprint positioning method.
Then, we place film in the polarization pattern and extract the fingerprint from it. We added some marker points and marker lines on the whiteboard. The function of the marker points is to record the projection point at the center of the color polarizer, while the function of the marker lines is to record the direction of the color polarizer. In this paper, the fingerprint picture cut into a square shape. The detailed steps of the method are shown in Figure 2.
We theoretically proved that under the condition of using the same type of color polarizer, fingerprints collected in one environment could be used in many different environments.
After the polarized light is incident on the surface of the birefringent crystal, intuitively, a beam of light is divided into two beams, ordinary light and extraordinary light. When entering the crystal, the phase difference between the two beams of light is zero, after passing through the wave chip with a thickness of d. The phase difference between e-light and o-light is δ 1 , where n o is the refractive of ordinary light and n e is the refractive of extraordinary light.
δ 1 = 2 π λ n o n e d .
O-ray and e-ray pass through the birefringent crystal and enter another polarizer, and only the partial amplitudes L e 2 and L o 2 along the direction of the transmission axis can pass through P 2 . As shown in Figure 1, respectively:
A e 2 = A 1 cos ( θ 1 θ 2 ) , A o 2 = A 2 sin ( θ 1 θ 2 ) .

4.2. Position

First, the fingerprint image is sampled to improve the locating speed without affecting the locating accuracy. According to the straight-line propagation of light, the fingerprint pattern is expanded to the whole space. As shown in Figure 3, the color of the color polarizer observed at points B and C should be the same as that of Point A. Thus, the hue fingerprint has an equal value at both points, and similarly, on a ray with a light source as the vertex, the hue fingerprint has the same amount. Using the theory of straight-line propagation of light, mapping the color fingerprint collected at a fixed distance to any distance, the color fingerprint of the whole space can be obtained.
As shown in Figure 1, we use θ to indicate the incident angle of L 1 and L 2 to S, and thickness of S is d. θ o and θ e are refraction angle of ordinary ray and extraordinary ray of L 1 e and L 2 o , respectively. γ is the angle between optic axis and the projection of incident light. n a i r is the refractive index of light in air, n o and n e are the refractive indexes of ordinary light and extraordinary light in birefringent crystals, respectively. The optical path different of L 1 e and L 2 o at point Q is δ 1 , which can be calculated as:
δ 1 = F A ¯ n a i r + A D ¯ n e B D ¯ n o = d tan θ o tan θ e sin θ n air + d cos θ e n e d cos θ o n o .
In Equation (3), F A ¯ , A D ¯ and B D ¯ are the actual distances between two points from A to F, from A to D, and from B to D. So, we have:
δ 1 = d n e cos θ e n o cos θ o .
Inspired by [9], in birefringence, the direction vector of the optical axis is e a ; the direction vector of ordinary rays is e k o , and the direction vector of special rays is e k e , as shown below:
e a = ( cos γ , sin γ , 0 ) ,
e k o = sin θ o , 0 , cos θ o ,
e k e = sin θ e , 0 , cos θ e .
The angle between e a and e k e can be written as α . According to Equations (5) and (7), we have:
cos α = e a · e k e = cos γ sin θ e .
In birefringent materials, the refractive index of unusual light is not fixed and will change with the change of incident angle. n e is the refractive index of extraordinary ray in birefringent material; thus, we know that:
n e = N o N e N o 2 sin 2 α + N e 2 cos 2 α = N o N e N o 2 + N e 2 N o 2 cos 2 α .
For a fixed birefringent material, the main refractive index is a fixed value. According to Equations (8) and (9), we have:
n e = N o N e N o 2 + N e 2 N o 2 cos 2 γ sin 2 θ e .
n o is the refractive index of ordinary ray in birefringent material. According to Snell’s Law, the following formula can be derived:
n a i r sin θ = n e sin θ e = n o sin θ o .
where n a i r is similar to one, which is the refractive index in air. Thus, we know that:
n e = sin θ sin θ e .
According to Equations (9) and (12), we have:
θ e = arcsin sin 2 θ N e 2 sin 2 θ N e 2 N o 2 cos 2 γ cos 2 γ .
Finally, according to Equations (12) and (13), we have:
n e = N e 2 sin 2 θ N e 2 N o 2 cos 2 γ cos 2 γ .
Because the optical path difference is:
δ 1 = d n e cos θ e n o cos θ o .
We substitute n e , θ e , and n o , θ o into Equation (15):
δ 1 = d ( N e 2 sin 2 θ sin 2 Y + N e 2 N o 2 cos 2 γ N o 2 sin 2 θ ) .
N e and N e are refractive indices of S. The index of refraction is a fixed value relative to a fixed material. γ is the angle between the projection of incident light onto the plane of incidence and the optical axis of the plane of incidence.
For a specific wavelength of light λ , the phase different δ 2 at point D in Figure 1 can be described as:
δ 2 = δ 1 2 π λ .
As can be seen from the above, δ 1 is the reason for different colors. It can be seen that the right part of Equation (14) is only related to angle and distance value and is unrelated to the incident light and ambient light conditions. This means that the color of the color polarizer has no connection with the ambient light, only connected with the collection location. Therefore, as long as the color information of the color polarizing plate is obtained, the shooting position information can be inferred from the fingerprint pattern. Because hue is the primary characteristic of color, it is the most accurate standard for distinguishing different colors. Here, we choose the hue value as an indicator to identify different colors.
During positioning, the camera is only needed to point at the light source to shoot, and extract the color value of the color polarizer on the light source. Then, measure the angle between the light source where the color polarizer is located and the shooting device, a set of rays approximately distributed on the surface of the cone is made, and multiple (four in this paper) sets of rays are measured, and the intersection of these rays is found. The intersection location is the location of the shooting device, as shown in Figure 4.

5. Experiment

The experiment can be divided into two parts. The first part is to make color polarizers and to collect reverse fingerprints. The second part is to take pictures and position them. The time cost of calculating a set of positions is about 1–30 s. The experimental scene is shown in Figure 5.

5.1. Collect Reverse Fingerprint

As shown in Figure 1, we first need to make a color polarizer. We use a polarizer with a polarization angle of 90 degrees as the polarizing crystal and a transparent tape as the birefringent crystal to make color polarizers. Attach the birefringent crystal between the two polarizers. Note that the polarization directions of the two polarizers cannot be parallel. We rotated one of them by 90 degrees. The cost of a color polarizer is meager, no more than 5 cents each.
Since the hue fingerprint corresponds to the angle value of the shooting point and the polarizing color plate, the position of the shooting point can be determined using multiple color polarizers. Therefore, the first part is to establish a fingerprint database. This part is to establish the mapping between tone value and direction value, as shown in Figure 3. For polarizers of the same color, it is only necessary to create a fingerprint map once—that is, to establish a fingerprint database. The second part is to coordinate positioning. In this part, the camera uses a color polarizer with multiple different positions and different rotation angles, as shown in Figure 2. According to the fingerprint database established in the first part, the direction information of each color polarizer can be calculated. Therefore, the angle of arrival positioning algorithm can be used to calculate the coordinate information of the camera.
The collection method is as follows: First, a color polarizer is placed in front of a white point light source. We take the position of the color polarizer as the coordinate origin. Then, we place an opaque whiteboard parallel to the color polarizer and turn off other illumination lights except for the white point light source. At this time, a clear color polarization pattern will appear on the whiteboard due to the reflection of the incident light by the whiteboard. The second step is to capture the color polarization pattern appearing on the whiteboard and map the hue value and shooting angle. Here, the distance between the whiteboard and the color polarizer is 5 cm, so the resolution of the color polarization pattern is high.
For white light sources in different positions and directions in the room, only a color polarizer of the same model that does not need to be specially designed is attached because the same color polarizer’s fingerprint is the same. No additional overhead is required. Regarding the portability of the scene, the color polarizer can be plug-and-play. For scenes with multiple light sources, one only needs to know each light source’s relative position and any light source’s absolute position. The interference between the light sources is negligible. Since the color polarizer is close to the light source, the ambient light’s intensity is much lower than the intensity of the light source, so it will not affect the light.

5.2. 3D Localization

To achieve coordinate positioning, we first paste several color polarizers at a specific interval on a transparent plane. To ensure the accuracy of the positioning results, we used four-color polarizers S1, S2, S3, and S4, some of the more varied images, as shown in Figure 6, and arranged the four-color polarizers according to a specific relative position. The central positions of S1, S2, S3, and S4 are p1, p2, p3, and p4, respectively. Use the midpoint positions of p1, p2, p3, and p4 as reference points. Move the mobile phone camera to display the color polarization of the three-dimensional area with the color polarizer as the apex as one position of each photo included. For the sampling position r, it derives the hue value h for the chip from the captured photo. The mapping between the direction of the light and the hue value can be constructed by sampling at different locations.
Because the light propagates along a straight line in the same medium, as shown in Figure 3, the color development of the color polarizer at point C is the same as the color observed at points A. Therefore, it can be deduced that if the color polarizer is observed at point C, the color value is the same as the color values of points A and B, and it is evident that the hue value is also the same. Therefore, the fingerprint information can be extended to the entire space.

6. Evaluation

We evaluate the performance of the reverse fingerprint collection method from the following aspects:
  • The influence of different distances on positioning accuracy;
  • The influence of fingerprints collected under different lights and distances;
  • The effect of different color polarizer placement on the positioning results;
  • The influence of different periods of a day on positioning accuracy;
  • The influence of the vertical distance between the light source and camera position on positioning accuracy;
  • The influence of different pixel camera on positioning accuracy;
  • The influence of different ambient light on positioning accuracy.

6.1. Localization Accuracy

Figure 6 shows the photo of the color polarizer we used to locate. In the experiment, we attached the color polarizer to the light source and moved the phone to different positions in a room of 4 × 4 × 2 m. Figure 7 shows the positioning errors of mobile phones in different positions. It can be seen that the “Vertical” group has the highest positioning accuracy. In 95% of cases, the positioning accuracy can be guaranteed to be less than 10 cm. For the “Parallel” group and the “Circular” group, the positioning accuracy can be guaranteed to be less than 20 cm in 95% of cases. We can see that most positioning errors in the x and y direction are within 10 cm, with an average error of about 3 cm.

6.2. Impact of Different Fingerprints

We collected fingerprints in different environments to test the impact on the positioning results. (1) In the absence of other ambient light, fingerprints projected by white light, which is called “fp1”, as shown in Figure 8; (2) The fingerprint projected by the white light under the condition of normal ambient light, which is called “fp2”; (3) In the absence of other ambient light, the fingerprint projected by the warm white light, which is called “fp3”. Impact of fingerprints collected in different situations on the results, as shown in Figure 8. It can be observed that in the absence of ambient light, the test results corresponding to the white light group are the best. The test result of the yellow light group without ambient light is the worst. The test results of the white light group with ambient light are only slightly worse than the white light group without ambient light. It can be seen that the reverse fingerprint collection method has high robustness. The influence of ambient light on the accuracy of the fingerprint is small, and the color of the light source has a significant influence on the positioning result.

6.3. Impact of Different Color Polarizer Placements

The different relative positions of color polarizers also have an impact on the positioning results. We tested three different arrangements of color polarizers, respectively named parallel, vertical, and circular. “Parallel” means that the four color-polarizers have only translated, not rotated; “Vertical” means that the four-color polarizers rotate by 90 degrees each based on translation; “Circular” means that four color-polarizers are rotated 60 or 120 degrees while being translated. It can be seen that the test result of the parallel group is the worst, and the test result of the vertical group is the best. As shown in Figure 9, the position error of the circular group is between the vertical and the parallel group.

6.4. Influence of Different Time Periods of a Day

We have observed that there are apparent changes in light in the early morning and noon, and there are also differences in outdoor light on rainy and sunny days. In order to explore the influence of different periods of the day on positioning, we used the same camera and shooting angle to collect photos of the color polarizer during the period from 7:00 to 20:00 during the day. Figure 10 shown the difference in positioning accuracy overtime when the color polarizer is attached to the ceiling light and the window. We found that the color polarizers attached to the windows changed significantly with different times of the day. The color polarizers on the window use sunlight as the light source, so the positioning error in the evening will increase with the change of light color and intensity, as shown in Figure 10. When the color polarizer attached to the ceiling lamp is positioned, it is not affected by different periods of the day.

6.5. Influence of Vertical Distance between Light Source and Camera Position

To study the difference in positioning accuracy between the color polarizer and the camera at different vertical distances. We start with a vertical distance of 0.5 m between the color polarizer and the camera and measure points that are on a line perpendicular to the ground. The positioning accuracy is measured every time the vertical distance is increased by 0.5 m. We found that positioning accuracy gradually improved as the distance decreased. When the distance between the camera and the color polarizer is only 0.5 m, the positioning error can be reduced to within 2 cm under the lamp and within 4 cm under natural light. As shown in Figure 11, when the vertical distance between the camera and the color polarizer is 3 m, the positioning accuracy under the lamp is 4–5 cm on average.

6.6. Impact of Different Pixel Camera

In order to study the impact of cameras with different pixels on the positioning accuracy, we compared the differences in positioning accuracy caused by photos from 600 × 480 pixels to 4080 × 2720 pixels. We found that when the camera pixel is only 30W because the color polarizer itself is small, a color polarizer occupies a small photo area. Excluding the pixels of the outermost circle of the color polarizer (because it is uncertain that the outermost pixels belong to the imaging range of the color polarizer), the number of remaining pixels is small, so the error obtained is larger. As shown in Figure 12, the positioning accuracy obtained by a 4080 × 2720 pixel camera is 2–4 cm greater.

6.7. Impact of Different Ambient Light

There are some differences in the positioning results of color polarizer under different environments. As shown in Table 1, the group with no ambient light interference has the best positioning effect, because the test environment in this case is the same as the fingerprint collection environment. In the natural light environment (the color polarizer is directly placed on the window and positioned with sunlight), the positioning results are the worst. We consider that the main reason for the high positioning error is the complex environment outside the window. Both the ground and the sky have colors, and it is difficult to distinguish whether the collected colors are generated by the color polarizer or the background refraction. When other lights are on at the same time, the positioning accuracy is not affected much. Therefore, the fingerprint locating method proposed in this paper has better environmental robustness.

7. Conclusions

This paper improves the fingerprint position method and implements the reverse fingerprint construction method. The advantages of using the reverse fingerprint collection method are as follows: First, it does not need to take multiple photos to build a fingerprint dataset and take only one picture to build the fingerprint library of the whole space. Second, the fingerprints collected in one environment can be reused in multiple different environments. Third, it avoids the decrease in positioning accuracy because of insufficient sampling density. We theoretically proved that the acquisition of fingerprint information could be used for multiple conditions. Then, we compared the effect of different relative positions of the color polarizer on the positioning accuracy. The evaluation results show that reverse fingerprint position method achieves an average localization error of about 3 cm in 2D, and in 95% of cases, the positioning accuracy can be guaranteed to be less than 10 cm. This paper has high practical significance at the application level for the indoor positioning of intelligent cars, UAVs, and other equipment. Taken together, the findings of this study have a number of important implications for future practice.
This limitation of this study is that the positioning process requires shooting towards the light source, so it is more suitable for smart cars or drones with cameras. Further research might explore that integrate the part that recognizes the LED-ID into the positioning algorithm.

Author Contributions

Conceptualization, C.S. and T.L.; methodology, X.N.; software, C.S.; validation, C.S., T.L., and C.H.; formal analysis, C.S.; investigation, C.S.; resources, C.S.; data curation, T.L.; writing—original draft preparation, S.L.; writing—review and editing, C.S.; visualization, C.S.; supervision, T.L.; project administration, Q.N.; funding acquisition, Q.N. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China (No. 51674255).

Acknowledgments

The author would like to thank the editor and anonymous reviewers for their thoughtful comments and suggestions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Torres, J.C.; Montes, A.; Mendoza, S.L.; Fernandez, P.R.; Betancourt, J.S.; Escandell, L.; del Valle, C.I.; Sanchez-Pena, J.M. A Low-Cost Visible Light Positioning System for Indoor Positioning. Sensors 2020, 20, 5145. [Google Scholar] [CrossRef] [PubMed]
  2. Chen, G.; Chen, W.; Yang, Q.; Xu, Z.; Yang, L.; Conradt, J.; Knoll, A. A Novel Visible Light Positioning System With Event-Based Neuromorphic Vision Sensor. IEEE Sens. J. 2020, 20, 10211–10219. [Google Scholar] [CrossRef]
  3. Knudde, N.; Raes, W.; De Bruycker, J.; Dhaene, T.; Stevens, N. Data-Efficient Gaussian Process Regression for Accurate Visible Light Positioning. IEEE Commun. Lett. 2020, 24, 1705–1709. [Google Scholar] [CrossRef]
  4. Wu, H.; Wang, Q.; Xiong, J.; Zuniga, M. SmartVLC: Co-Designing Smart Lighting and Communication for Visible Light Networks. IEEE Trans. Mob. Comput. 2020, 19, 1956–1970. [Google Scholar] [CrossRef]
  5. Aparicio-Esteve, E.; Hernandez, A.; Urena, J.; Villadangos, J.M. Visible Light Positioning System Based on a Quadrant Photodiode and Encoding Techniques. IEEE Trans. Instrum. Meas. 2020, 69, 5589–5603. [Google Scholar] [CrossRef]
  6. Zhou, B.; Liu, A.; Lau, V. Visible Light-Based User Position, Orientation and Channel Estimation Using Self-Adaptive Location-Domain Grid Sampling. IEEE Trans. Wirel. Commun. 2020, 19, 5025–5039. [Google Scholar] [CrossRef]
  7. Hong, C.Y.; Wu, Y.C.; Liu, Y.; Chow, C.W.; Yeh, C.H.; Hsu, K.L.; Lin, D.C.; Liao, X.L.; Lin, K.H.; Chen, Y.Y. Angle-of-Arrival (AOA) Visible Light Positioning (VLP) System Using Solar Cells with Third-Order Regression and Ridge Regression Algorithms. IEEE Photonics J. 2020, 12. [Google Scholar] [CrossRef]
  8. De-La-Llana-Calvo, A.; Lazaro-Galilea, J.L.; Gardel-Vicente, A.; Rodriguez-Navarro, D.; Rubiano-Muriel, B.; Bravo-Munoz, I. Analysis of Multiple-Access Discrimination Techniques for the Development of a PSD-Based VLP System. Sensors 2020, 20, 1717. [Google Scholar] [CrossRef] [Green Version]
  9. Li, L.; Xie, P.; Wang, J.; Acm. RainbowLight: Towards Low Cost Ambient Light Positioning with Mobile Phones. In Proceedings of the Mobicom’18, 24th Annual International Conference on Mobile Computing and Networking, New Delhi, India, 29 October–2 November 2018; pp. 445–457. [Google Scholar] [CrossRef]
  10. Keskin, M.F.; Sezer, A.D.; Gezici, S. Localization via Visible Light Systems. Proc. IEEE 2018, 106, 1063–1088. [Google Scholar] [CrossRef] [Green Version]
  11. Lee, Y.U.; Park, S.H. Short-range Visible Light Positioning Based on Angle of Arrival for Smart Indoor Service. J. Electr. Eng. Technol. 2018, 13, 1363–1370. [Google Scholar] [CrossRef]
  12. Chen, H.; Guan, W.; Li, S.; Wu, Y. Indoor high precision three-dimensional positioning system based on visible light communication using modified genetic algorithm. Opt. Commun. 2018, 413, 103–120. [Google Scholar] [CrossRef]
  13. Xie, C.; Guan, W.; Wu, Y.; Fang, L.; Cai, Y. The LED-ID Detection and Recognition Method Based on Visible Light Positioning Using Proximity Method. IEEE Photonics J. 2018, 10. [Google Scholar] [CrossRef]
  14. Lin, X.; Zhang, L. Intelligent and Practical Deep Learning Aided Positioning Design for Visible Light Communication Receivers. IEEE Commun. Lett. 2020, 24, 577–580. [Google Scholar] [CrossRef]
  15. Soto, I.; Nilson Rodrigues, R.; Massuyama, G.; Seguel, F.; Palacios Jativa, P.; Azurdia-Meza, C.A.; Krommenacker, N. A Hybrid VLC-RF Portable Phasor Measurement Unit for Deep Tunnels. Sensors 2020, 20, 790. [Google Scholar] [CrossRef] [Green Version]
  16. Konings, D.; Faulkner, N.; Alam, F.; Lai, E.M.K.; Demidenko, S. FieldLight: Device-Free Indoor Human Localization Using Passive Visible Light Positioning and Artificial Potential Fields. IEEE Sens. J. 2020, 20, 1054–1066. [Google Scholar] [CrossRef]
  17. Wu, Y.; Liu, X.; Guan, W.; Chen, B.; Chen, X.; Xie, C. High-speed 3D indoor localization system based on visible light communication using differential evolution algorithm. Opt. Commun. 2018, 424, 177–189. [Google Scholar] [CrossRef]
  18. Vieira, M.; Vieira, M.A.; Louro, P.; Vieira, P. Light-emitting diodes aided indoor localization using visible light communication technology. Opt. Eng. 2018, 57. [Google Scholar] [CrossRef]
  19. Li, Y.; Ghassemlooy, Z.; Tang, X.; Lin, B.; Zhang, Y. A VLC Smartphone Camera Based Indoor Positioning System. IEEE Photonics Technol. Lett. 2018, 30, 1171–1174. [Google Scholar] [CrossRef]
  20. Amsters, R.; Demeester, E.; Stevens, N.; Slaets, P. In-Depth Analysis of Unmodulated Visible Light Positioning Using the Iterated Extended Kalman Filter. Sensors 2019, 19, 5198. [Google Scholar] [CrossRef] [Green Version]
  21. Almadani, Y.; Ijaz, M.; Joseph, W.; Bastiaens, S.; Rajbhandari, S.; Adebisi, B.; Plets, D. A Novel 3D Visible Light Positioning Method Using Received Signal Strength for Industrial Applications. Electronics 2019, 8, 1311. [Google Scholar] [CrossRef] [Green Version]
  22. Yang, F.; Gao, J.; Liu, Y. Indoor visible light positioning system based on cooperative localization. Opt. Eng. 2019, 58. [Google Scholar] [CrossRef] [Green Version]
  23. Tran, H.Q.; Ha, C. Fingerprint-Based Indoor Positioning System Using Visible Light Communication—A Novel Method for Multipath Reflections. Electronics 2019, 8, 63. [Google Scholar] [CrossRef] [Green Version]
  24. Keskin, M.F.; Sezer, A.D.; Gezici, S. Optimal and Robust Power Allocation for Visible Light Positioning Systems Under Illumination Constraints. IEEE Trans. Commun. 2019, 67, 527–542. [Google Scholar] [CrossRef]
  25. Hao, J.; Chen, J.; Wang, R. Visible Light Positioning Using A Single LED Luminaire. IEEE Photonics J. 2019, 11. [Google Scholar] [CrossRef]
  26. Gong, C. Visible Light Communication and Positioning: Present and Future. Electronics 2019, 8, 788. [Google Scholar] [CrossRef] [Green Version]
  27. Xu, J.; Gong, C.; Xu, Z. Experimental Indoor Visible Light Positioning Systems With Centimeter Accuracy Based on a Commercial Smartphone Camera. IEEE Photonics J. 2018, 10. [Google Scholar] [CrossRef]
  28. Stevens, N.; Steendam, H. Magnitude of the Distance Estimation Bias in Received Signal Strength Visible Light Positioning. IEEE Commun. Lett. 2018, 22, 2250–2253. [Google Scholar] [CrossRef]
  29. Gligoric, K.; Ajmani, M.; Vukobratovic, D.; Sinanovic, S. Visible Light Communications-Based Indoor Positioning via Compressed Sensing. IEEE Commun. Lett. 2018, 22, 1410–1413. [Google Scholar] [CrossRef] [Green Version]
  30. Phong Ha, N.; Arsalan, M.; Koo, J.H.; Naqvi, R.A.; Noi Quang, T.; Park, K.R. LightDenseYOLO: A Fast and Accurate Marker Tracker for Autonomous UAV Landing by Visible Light Camera Sensor on Drone. Sensors 2018, 18, 1703. [Google Scholar] [CrossRef] [Green Version]
  31. Prince, G.B.; Little, T.D.C. Two-Phase Framework for Indoor Positioning Systems Using Visible Light. Sensors 2018, 18, 1917. [Google Scholar] [CrossRef] [Green Version]
  32. Guan, W.; Chen, X.; Huang, M.; Liu, Z.; Wu, Y.; Chen, Y. High-Speed Robust Dynamic Positioning and Tracking Method Based on Visual Visible Light Communication Using Optical Flow Detection and Bayesian Forecast. IEEE Photonics J. 2018, 10. [Google Scholar] [CrossRef]
  33. Zhao, H.X.; Wang, J.T. A Novel Three-Dimensional Algorithm Based on Practical Indoor Visible Light Positioning. IEEE Photonics J. 2019, 11. [Google Scholar] [CrossRef]
  34. Chuang, Y.C.; Li, Z.Q.; Hsu, C.W.; Liu, Y.; Chow, C.W. Visible light communication and positioning using positioning cells and machine learning algorithms. Opt. Express 2019, 27, 16377–16383. [Google Scholar] [CrossRef]
  35. Afzalan, M.; Jazizadeh, F. Indoor Positioning Based on Visible Light Communication: A Performance-based Survey of Real-world Prototypes. Acm Comput. Surv. 2019, 52. [Google Scholar] [CrossRef]
  36. Huang, H.; Lin, B.; Feng, L.; Lv, H. Hybrid indoor localization scheme with image sensor-based visible light positioning and pedestrian dead reckoning. Appl. Opt. 2019, 58, 3214–3221. [Google Scholar] [CrossRef]
  37. Yuan, T.; Xu, Y.; Wang, Y.; Han, P.; Chen, J. A Tilt Receiver Correction Method for Visible Light Positioning Using Machine Learning Method. IEEE Photonics J. 2018, 10. [Google Scholar] [CrossRef]
  38. Tran, H.Q.; Ha, C. Improved Visible Light-Based Indoor Positioning System Using Machine Learning Classification and Regression. Appl. Sci. 2019, 9, 1048. [Google Scholar] [CrossRef] [Green Version]
  39. Wu, Y.; Guo, Z.; Liu, X.; Xian, Y.; Guan, W. High precision and high speed of three-dimensional indoor localization system based on visible light communication using improved bacterial colony chemotaxis algorithm. Opt. Eng. 2019, 58. [Google Scholar] [CrossRef]
  40. Xie, Z.; Guan, W.; Zheng, J.; Zhang, X.; Chen, S.; Chen, B. A High-Precision, Real-Time, and Robust Indoor Visible Light Positioning Method Based on Mean Shift Algorithm and Unscented Kalman Filter. Sensors 2019, 19, 1094. [Google Scholar] [CrossRef] [Green Version]
  41. Kho, A.; Srinivasan, V.J. Compensating spatially dependent dispersion in visible light OCT. Opt. Lett. 2019, 44, 775–778. [Google Scholar] [CrossRef]
  42. Cincotta, S.; He, C.; Neild, A.; Armstrong, J. Indoor Visible Light Positioning: Overcoming the Practical Limitations of the Quadrant Angular Diversity Aperture Receiver (QADA) by Using the Two-Stage QADA-Plus Receiver. Sensors 2019, 19, 956. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. De-La-Llana-Calvo, A.; Lazaro-Galilea, J.L.; Gardel-Vicente, A.; Rodriguez-Navarro, D.; Bravo-Munoz, I.; Espinosa-Zapata, F. Characterization of Multipath Effects in Indoor Positioning Systems by AoA and PoA Based on Optical Signals. Sensors 2019, 19, 917. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Guan, W.; Wen, S.; Liu, L.; Zhang, H. High-precision indoor positioning algorithm based on visible light communication using complementary metal-oxide-semiconductor image sensor. Opt. Eng. 2019, 58. [Google Scholar] [CrossRef]
  45. Guo, C.; Shao, J. Implementation and improvement of Bayes’s theorem for indoor visible light positioning system. Opt. Eng. 2019, 58. [Google Scholar] [CrossRef]
  46. Qin, C.; Zhan, X. VLIP: Tightly Coupled Visible-Light/Inertial Positioning System to Cope With Intermittent Outage. IEEE Photonics Technol. Lett. 2019, 31, 129–132. [Google Scholar] [CrossRef]
  47. Du, P.; Zhang, S.; Chen, C.; Yang, H.; Zhong, W.D.; Zhang, R.; Alphones, A.; Yang, Y. Experimental Demonstration of 3D Visible Light Positioning Using Received Signal Strength with Low-Complexity Trilateration Assisted by Deep Learning Technique. IEEE Access 2019, 7, 93986–93997. [Google Scholar] [CrossRef]
  48. Zhang, Z.; Chen, H.; Hong, X.; Chen, J.; IEEE. Accuracy Enhancement of Indoor Visible Light Positioning using Point-Wise Reinforcement Learning. In Proceedings of the Optical Fiber Communications Conference, San Diego, CA, USA, 3–7 March 2019. [Google Scholar]
  49. Li, N.; Qiao, Y.; Zhang, T.; Lu, Y. Dead-zone-free three-dimensional indoor positioning method based on visible light communication with dimensionality reduction algorithm. Opt. Eng. 2018, 57. [Google Scholar] [CrossRef]
  50. Wang, Q.; Luo, H.; Men, A.; Zhao, F.; Gao, X.; Wei, J.; Zhang, Y.; Huang, Y. Light positioning: A high-accuracy visible light indoor positioning system based on attitude identification and propagation model. Int. J. Distrib. Sens. Netw. 2018, 14. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Illustration of optical ray. The birefringent plate S is placed between the polarizing plate P 1 and P 2 . As light passes through, this group of units produces a color polarization effect.
Figure 1. Illustration of optical ray. The birefringent plate S is placed between the polarizing plate P 1 and P 2 . As light passes through, this group of units produces a color polarization effect.
Sensors 20 07245 g001
Figure 2. Reverse fingerprint location architecture.
Figure 2. Reverse fingerprint location architecture.
Sensors 20 07245 g002
Figure 3. Illustration of fingerprint mapping.
Figure 3. Illustration of fingerprint mapping.
Sensors 20 07245 g003
Figure 4. Illustration of location.
Figure 4. Illustration of location.
Sensors 20 07245 g004
Figure 5. Illustration of location.
Figure 5. Illustration of location.
Sensors 20 07245 g005
Figure 6. The photo of the color polarizer in different environments.
Figure 6. The photo of the color polarizer in different environments.
Sensors 20 07245 g006
Figure 7. Infuence of different relative-positions on location.
Figure 7. Infuence of different relative-positions on location.
Sensors 20 07245 g007
Figure 8. Impact of fingerprints collected in different situations.
Figure 8. Impact of fingerprints collected in different situations.
Sensors 20 07245 g008
Figure 9. Impact of different color polarizer placements.
Figure 9. Impact of different color polarizer placements.
Sensors 20 07245 g009
Figure 10. The influence of different time periods of a day on positioning accuracy.
Figure 10. The influence of different time periods of a day on positioning accuracy.
Sensors 20 07245 g010
Figure 11. Influence of vertical distance between light source and camera position.
Figure 11. Influence of vertical distance between light source and camera position.
Sensors 20 07245 g011
Figure 12. Influence of different pixel camera on positioning accuracy.
Figure 12. Influence of different pixel camera on positioning accuracy.
Sensors 20 07245 g012
Table 1. Different color polarizer relative position.
Table 1. Different color polarizer relative position.
EnvironmentPhotoMean Error
Natural Light Sensors 20 07245 i00125.45 cm
W/ Luminaires Sensors 20 07245 i0027.79 cm
W/O Luminaires Sensors 20 07245 i0033.3 cm
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Shi, C.; Niu, X.; Li, T.; Li, S.; Huang, C.; Niu, Q. Exploring Fast Fingerprint Construction Algorithm for Unmodulated Visible Light Indoor Localization. Sensors 2020, 20, 7245. https://doi.org/10.3390/s20247245

AMA Style

Shi C, Niu X, Li T, Li S, Huang C, Niu Q. Exploring Fast Fingerprint Construction Algorithm for Unmodulated Visible Light Indoor Localization. Sensors. 2020; 20(24):7245. https://doi.org/10.3390/s20247245

Chicago/Turabian Style

Shi, Chenqi, Xinyv Niu, Tao Li, Sen Li, Chanjuan Huang, and Qiang Niu. 2020. "Exploring Fast Fingerprint Construction Algorithm for Unmodulated Visible Light Indoor Localization" Sensors 20, no. 24: 7245. https://doi.org/10.3390/s20247245

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop