Augmented Reality and GPS-Based Resource Efficient Navigation System for Outdoor Environments: Integrating Device Camera, Sensors, and Storage
Abstract
:1. Introduction
- Location Information: The location information component provides the location information. These components can be a direct or indirect source of location providers, e.g., GPS receivers, inertial sensors, deduced reckoning techniques, cellular systems, and Wi-Fi devices. GPS receiver provides output in the form of longitude and latitudes but sometimes lacks in performance due to shielding effects.
- Reference data: Reference data provides digital map information for the geographical entities. This information includes location, topological, Arial, and content information. The sources of reference data can be proprietary or non-proprietary. Proprietary data sources are Google Maps, Bing Maps, TomTom map, etc. Non-proprietary data sources include OpenStreetMap data, GPX records, etc.
- Processing Unit: The processing unit is responsible for information retrieval and knowledge generation. This system fetches the information from the location information component and reference data source and uses its supporting tool to retrieve the knowledge.
- Output Unit: Any audio-visual device that can communicate knowledge to the user. The output unit takes the help of the graphical user interface or some storage medium for displaying the output.
2. Literature Studies
3. Research Methodology
3.1. Fundamental Terms
- Node: A node is the fundamental element of the map. If we consider a map a graph, then the node is equivalent to a vertex of the graph. For example, M (V, E) is a map, V comprises all the map nodes, and E comprises all the map edges. In Figure 1, A-I is the map node, and set V comprises [A, B, C, D… I].
- Edge: An edge is a link between two nodes of the map. If vi, vj are the nodes of map M (V, E), then edge eij is the direct link between vi and vj. Whereas vi, vj € V and eij € E. In a map, the collection of edges is called a road. A road consists of finite connected edges. Figure 1 shows the edge as a link between two nodes.
- Route: A route is a path between two directly or indirectly connected nodes. If two nodes are directly connected, the route is the same as edge, whereas if two nodes are not directly connected, the route is a collection of adjacent edges. The route always has a finite length. In Figure 1, A-B-D-F-H-I is an example of a route.
- GPS receiver output: GPS receiver output provides the positional and temporal information of the device. It comprises latitude and longitude information with a timestamp.
- GPS Trajectory: GPS trajectory is formed by collecting continuous GPS points with respect to time. Figure 1 shows a sample scenario of a road network where A–I are the road nodes and GPS trajectory collected from GPS receiver by traversing path A-C-E-G-I is shown using a dotted line. Each trajectory element includes latitude, longitude, and time information.
3.2. A Star Algorithm
3.3. Nearest Neighbor Search Algorithm
3.4. The Proposed System
3.4.1. Data Preparation (S1)
3.4.2. Location Identification (S2)
3.4.3. Route Identification (S3)
3.4.4. Visual Output (S4)
4. The REN System
Algorithm-1: REN (G, S, E) |
Input: Finite connected map data comprises V vertices and E edges. Output: Route from source to destination |
|
5. Case Analysis
5.1. Comparison Metrics
5.2. Experimental Results
6. Future Scope and Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Papagiannakis, G.; Singh, G.; Magnenat-Thalmann, N. A survey of mobile and wireless technologies for augmented reality systems. Comput. Animat. Virtual Worlds 2008, 19, 3–22. [Google Scholar] [CrossRef] [Green Version]
- Wiley, J.; Pan, X.; Hamilton, A.F.d.C. Why and how to use virtual reality to study human social interaction: The challenges of exploring a new research landscape. Br. J. Psychol. 2018, 109, 395–417. [Google Scholar] [CrossRef] [Green Version]
- Panzieri, S.; Pascucci, F.; Ulivi, G. An outdoor navigation system using GPS and inertial platform. IEEE/ASME Trans. Mechatronics 2002, 7, 134–142. [Google Scholar] [CrossRef]
- Maddison, R.; Mhurchu, C.N. Global positioning system: A new opportunity in physical activity measurement. Int. J. Behav. Nutr. Phys. Act. 2009, 6, 73. [Google Scholar] [CrossRef] [Green Version]
- Colpaert, P.; Abelshausen, B.; Melendez, J.A.R.; Delva, H.; Verborgh, R. Republishing OpenStreetMap’s roads as Linked Routable Tiles. In Proceedings of the European Semantic Web Conference, Portorož, Slovenia, 2–6 June 2019; pp. 13–17. [Google Scholar]
- Singh, S.; Singh, J. Intrinsic Parameters based Quality Assessment of Indian OpenStreetMap Dataset using Supervised Learning Technique. In Proceedings of the 2020 Indo—Taiwan 2nd International Conference on Computing, Analytics and Networks (Indo-Taiwan ICAN), Rajpura, Punjab, India, 7–15 February 2020; pp. 52–57. [Google Scholar]
- Singh, S.; Singh, J. Analysis of GPS Trajectories Mapping on Shape Files Using Spatial Computing Approaches. In Proceedings of the International Conference on Big Data Analytics, Sonepat, India, 15–18 December 2020; pp. 91–100. [Google Scholar]
- Sehra, S.S.; Singh, J.; Rai, H.S. Assessing OpenStreetMap Data Using Intrinsic Quality Indicators: An Extension to the QGIS Processing Toolbox. Futur. Internet 2017, 9, 15. [Google Scholar] [CrossRef] [Green Version]
- Sehra, S.S.; Singh, J.; Rai, H.S. Assessing the Topological Consistency of Crowdsourced OpenStreetMap Data. Hum. Comput. 2014, 1, 265–280. [Google Scholar] [CrossRef] [Green Version]
- Sehra, S.S.; Rai, H.S.; Singh, J. Quality Assessment of Crowdsourced Data against Custom Recorded Map Data. Indian J. Sci. Technol. 2015, 8, 1–6. [Google Scholar] [CrossRef]
- Zacharopoulou, D.; Skopeliti, A.; Nakos, B. Assessment and Visualization of OSM Consistency for European Cities. ISPRS Int. J. Geo-Inf. 2021, 10, 361. [Google Scholar] [CrossRef]
- Pazoky, S.H.; Pahlavani, P. Developing a multi-classifier system to classify OSM tags based on centrality parameters. Int. J. Appl. Earth Obs. Geoinf. 2021, 104, 102595. [Google Scholar] [CrossRef]
- Geisberger, R.; Sanders, P.; Schultes, D.; Delling, D. Contraction hierarchies: Faster and simpler hierarchical routing in road networks. In Proceedings of the International Workshop on Experimental and Efficient Algorithms, Provincetown, MA, USA, 30 May–1 June 2008; pp. 319–333. [Google Scholar]
- Bolliger, P.; Scherrer, M. Analysis Platform for OpenStreetMap. PhD Thesis, FHO Fachhochschule Ostschweiz, Buchs, Switzerland, 2020. [Google Scholar]
- Scott-Young, S.; Kealy, A. An intelligent navigation solution for land mobile location-based services. J. Navig. 2002, 55, 225–240. [Google Scholar] [CrossRef]
- Wang, E.; Li, Y.; Sun, A.; Gao, H.; Yang, J.; Fang, Z. Road detection based on illuminant invariance and quadratic estimation. Optik 2019, 185, 672–684. [Google Scholar] [CrossRef]
- Huang, H.; Gartner, G.; Krisp, J.M.; Raubal, M.; van de Weghe, N. Location based services: Ongoing evolution and research agenda. J. Locat. Based Serv. 2018, 12, 63–93. [Google Scholar] [CrossRef] [Green Version]
- Teipel, S.; Babiloni, C.; Hoey, J.; Kaye, J.; Kirste, T.; Burmeister, O.K. Information and communication technology solutions for outdoor navigation in dementia. Alzheimer’s Dement. 2016, 12, 695–707. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Brahmbhatt, S.; Hays, J. Deepnav: Learning to navigate large cities. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 21–26 July 2017; pp. 5193–5202. [Google Scholar]
- Li, Y.; Tong, G.; Sun, A.; Ding, W. Road extraction algorithm based on intrinsic image and vanishing point for unstructured road image. Rob. Auton. Syst. 2018, 109, 86–96. [Google Scholar] [CrossRef]
- Bonin-Font, F.; Ortiz, A.; Oliver, G. Visual Navigation for Mobile Robots: A Survey. J. Intell. Robot. Syst. 2008, 53, 263–296. [Google Scholar] [CrossRef]
- Mirowski, P.; Grimes, M.; Malinowski, M.; Hermann, K.M.; Anderson, K.; Teplyashin, D.; Simonyan, K.; Kavukcuoglu, K.; Zisserman, A.; Hadsell, R. Learning to Navigate in Cities Without a Map. Adv. Neural Inf. Process Syst. 2018, 31. [Google Scholar] [CrossRef]
- Krajnik, T.; Majer, F.; Halodova, L.; Vintr, T. Navigation without localisation: Reliable teach and repeat based on the convergence theorem. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018; pp. 1657–1664. [Google Scholar]
- Holmes, S.; Klein, G.; Murray, D.W. A square root unscented Kalman filter for visual monoSLAM. In Proceedings of the 2008 IEEE International Conference on Robotics and Automation, Pasadena, CA, USA, 19–23 May 2008; pp. 3710–3716. [Google Scholar]
- Mur-Artal, R.; Montiel, J.M.M.; Tardos, J.D. ORB-SLAM: A versatile and accurate monocular SLAM system. IEEE Trans. Robot. 2015, 31, 1147–1163. [Google Scholar] [CrossRef] [Green Version]
- Klein, G.; Murray, D. Parallel tracking and mapping for small AR workspaces. In Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, Nara, Japan, 13–16 November 2007; pp. 225–234. [Google Scholar]
- Hashim, H.A.; Eltoukhy, A.E.E. Landmark and IMU Data Fusion: Systematic Convergence Geometric Nonlinear Observer for SLAM and Velocity Bias. IEEE Trans. Intell. Transp. Syst. 2022, 23, 3292–3301. [Google Scholar] [CrossRef]
- Figueroa-Gonzalez, J.; Khachaturov, G.; Martinez-Hernandez, J.M. Generation of Non-Coordinate Navigation Knowledge from a Flow of Input Views. Res. Comput. Sci. 2019, 148, 139–151. [Google Scholar] [CrossRef]
- Ort, T.; Paull, L.; Rus, D. Autonomous vehicle navigation in rural environments without detailed prior maps. In Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia, 21–25 May 2018; pp. 2040–2047. [Google Scholar]
- Fan, T.; Cheng, X.; Pan, J.; Manocha, D.; Yang, R. Crowdmove: Autonomous mapless navigation in crowded scenarios. arXiv 2018, arXiv:1807.07870. [Google Scholar]
- Zhou, X.; Gao, F. Route Matching Research Based on Roadless Navigation Data Improvements on Hidden Markov Model. In Proceedings of the 3rd International Conference on Computer Science and Application Engineering, Sanya, China, 22–24 October 2019; pp. 1–6. [Google Scholar]
- Campigotto, P.; Rudloff, C.; Leodolter, M.; Bauer, D. Personalized and Situation-Aware Multimodal Route Recommendations: The FAVOUR Algorithm. IEEE Trans. Intell. Transp. Syst. 2017, 18, 92–102. [Google Scholar] [CrossRef]
- Hu, L.; Zhong, Y.; Hao, W.; Moghimi, B.; Huang, J.; Zhang, X.; Du, R. Optimal route algorithm considering traffic light and energy consumption. IEEE Access 2018, 6, 59695–59704. [Google Scholar] [CrossRef]
- Rehrl, K.; Gröchenig, S.; Wimmer, M. Optimization and evaluation of a high-performance open-source map-matching implementation. In Proceedings of the The Annual International Conference on Geographic Information Science, Wageningen, The Netherlands, 9–12 May 2018; pp. 251–270. [Google Scholar]
- Singh, S.; Singh, J.; Sehra, S.S. Genetic-inspired map matching algorithm for real-time GPS trajectories. Arab. J. Sci. Eng. 2020, 45, 2587–2603. [Google Scholar] [CrossRef]
- Singh, J.; Singh, S.; Singh, S.; Singh, H. Evaluating the performance of map matching algorithms for navigation systems: An empirical study. Spat. Inf. Res. 2019, 27, 63–74. [Google Scholar] [CrossRef]
- Singh, S.; Singh, J. Map Matching Algorithm: Empirical Review Based on Indian OpenStreetMap Road Network Data. Int. Arab J. Inf. Technol. 2022, 19, 143–149. [Google Scholar]
- Singh, S.; Singh, J.; Singh, S. Mitigating Spoofed GNSS Trajectories through Nature Inspired Algorithm. Geoinformatica 2020, 25, 581–600. [Google Scholar] [CrossRef]
- Singh, S.; Singh, J. Location Driven Edge Assisted Device and Solutions for Intelligent Transportation. In Fog, Edge, and Pervasive Computing in Intelligent IoT Driven Applications; Wiley: Hoboken, NJ, USA, 2020; pp. 123–147. [Google Scholar] [CrossRef]
- Rajeev, S.; Wan, Q.; Yau, K.; Panetta, K.; Agaian, S.S. Augmented reality-based vision-aid indoor navigation system in GPS denied environment. Mob. Multimed. Image Process. Secur. Appl. 2019, 10993, 143–152. [Google Scholar] [CrossRef]
- Joshi, R.; Hiwale, A.; Birajdar, S.; Gound, R. Indoor Navigation with Augmented Reality. Lect. Notes Electr. Eng. 2020, 570, 159–165. [Google Scholar] [CrossRef]
- Phupattanasilp, P.; Tong, S.R. Augmented Reality in the Integrative Internet of Things (AR-IoT): Application for Precision Farming. Sustainability 2019, 11, 2658. [Google Scholar] [CrossRef] [Green Version]
- Choi, J.; Lee, K.; Kim, H.; An, S.; Nam, D. Classification of Inter-Urban Highway Drivers’ Resting Behavior for Advanced Driver-Assistance System Technologies using Vehicle Trajectory Data from Car Navigation Systems. Sustainability 2020, 12, 5936. [Google Scholar] [CrossRef]
- Chidsin, W.; Gu, Y.; Goncharenko, I. AR-Based Navigation Using RGB-D Camera and Hybrid Map. Sustainability 2021, 13, 5585. [Google Scholar] [CrossRef]
- Amirian, P.; Basiri, A.; Gales, G.; Winstanley, A.; McDonald, J. The Next Generation of Navigational Services Using OpenStreetMap Data: The Integration of Augmented Reality and Graph Databases; Springer: Berlin/Heidelberg, Germany, 2015. [Google Scholar]
- Pereira, F.C.; Costa, H.; Pereira, N.M. An offline map-matching algorithm for incomplete map databases. Eur. Transp. Res. Rev. 2009, 1, 107–124. [Google Scholar] [CrossRef] [Green Version]
- Caruso, D.; Eudes, A.; Sanfourche, M.; Vissière, D.; le Besnerais, G. A Robust Indoor/Outdoor Navigation Filter Fusing Data from Vision and Magneto-Inertial Measurement Unit. Sensors 2017, 17, 2795. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Tyagi, N.; Singh, J.; Singh, S. Sensor Based Wearable Devices for Road Navigation. ECS Trans. 2022, 107, 8863–8869. [Google Scholar] [CrossRef]
- el Najjar, M.E.; Bonnifait, P. A road-matching method for precise vehicle localization using belief theory and Kalman filtering. Auton. Robot. 2005, 19, 173–191. [Google Scholar] [CrossRef]
- Alvarez, J.M.; Gevers, T.; Lopez, A.M. Vision-based road detection using road models. In Proceedings of the 2009 16th IEEE International Conference on Image Processing (ICIP), Cairo, Egypt, 7–10 November 2009; pp. 2073–2076. [Google Scholar]
- Tennety, S.; Kumar, M. Autonomous navigation in unknown road-like environments using support vector machines. In Proceedings of the ASME 2010 Dynamic Systems and Control Conference, Cambridge, MA, USA, 12–15 September 2010; pp. 727–733. [Google Scholar]
- Cao, K.; Wang, L.; Zuo, Z.; Sun, X. A Map Matching Algorithm Combining Twice Gridding and Weighting Factors Methods. In Proceedings of the International Symposium for Intelligent Transportation and Smart City, Shanghai, China, 9–11 May 2019; pp. 63–73. [Google Scholar]
- Xiao, X.; Liu, B.; Warnell, G.; Stone, P. Motion planning and control for mobile robot navigation using machine learning: A survey. Auton. Robot. 2022, 46, 569–597. [Google Scholar] [CrossRef]
- Tang, G.; Tang, C.; Claramunt, C.; Hu, X.; Zhou, P. Geometric A-Star Algorithm: An Improved A-Star Algorithm for AGV Path Planning in a Port Environment. IEEE Access 2021, 9, 59196–59210. [Google Scholar] [CrossRef]
- He, Z.; Liu, C.; Chu, X.; Negenborn, R.R.; Wu, Q. Dynamic anti-collision A-star algorithm for multi-ship encounter situations. Appl. Ocean Res. 2022, 118, 102995. [Google Scholar] [CrossRef]
- Li, J.; Ni, C.; He, D.; Li, L.; Xia, X.; Zhou, X. Efficient kNN query for moving objects on time-dependent road networks. VLDB J. 2022, 1–20. [Google Scholar] [CrossRef]
Map-Based | Map-Less | Mapbuild-Based |
---|---|---|
Requires prior knowledge of environment structure (such as geometric and topological information of the road network) for navigation [13,33,50]. | Recognises the road network during motion and makes the decision based on the non-map element [22,51,52]. | Builds map itself for the localization and routing, also called SLAM (Simultaneous Localization and Mapping) system [24,25,28,53]. |
These systems use predefined maps that include all geometrical and topological attributes. Routing and navigation algorithms are used to find the path and localization of the device. | These systems do not require a map for routing and localization. For navigation, these systems are trained on predefined routes, and after training, the device can move based on the training instruction. | These systems do not require a predefined map for localization and navigation but create a map while navigating. These systems use sensor and movement measurements for localization, but for routing and navigation, these systems build maps using cameras and sensors. |
GPS-based routing is an example of a map-based system. These systems generate the route using map information, starting address, and ending address. | Data transmission robots are an example of a map-less system. These systems are trained on a predefined route and after training, the robot can move on the same route without any map information. | Room cleaning robots are an example of mapbuild-based navigation. These robots use sensors and wheel movement information for obstacle avoidance and wall detection. These robots use cameras and sensors to create a map for navigating. |
Route Number | Distance (in km) | Road Beginning and Ending Position (Lat, Lon) in Degree Unit | Route Type |
---|---|---|---|
1 | 0.3 | (30.516913,76.660170)(30.514242,76.660846) | Pedestrian |
2 | 0.65 | (30.512529,76.658809)(30.517021,76.660418) | Pedestrian |
3 | 7.2 | (30.518102,76.659002)(30.487103,76.603105) | Road |
4 | 32.4 | (30.518102,76.659002)(30.338219,76.832267) | Road |
5 | 16 | (30.281446,76.834756)(30.335909,76.834155) | Road |
6 | 45.3 | (30.515920,76.658856)(30.258633,76.852609) | Road |
7 | 48.2 | (30.257539,76.852845)(30.478197,76.578609) | Road |
8 | 60.3 | (30.173239,76.861614)(30.532606,76.678967) | Road |
Route Number | User1 | User2 | User3 | User4 | User5 | User6 | User7 | User8 |
---|---|---|---|---|---|---|---|---|
Distance Covered (in km) | 80 | 105 | 186 | 33 | 93.5 | 108 | 134 | 77 |
Algorithm | Accuracy | Error | Key Features | Reference |
---|---|---|---|---|
ORB-SLAM | 93 percent | 46.58 and 1.59 m are the maximum and minimum RMSE | Uses ORB features to perform tracking, mapping, localisation and loop closing. | [25] |
GraphiumMM | 93.1 Percent | Minimum RMSE is 0.12 and maximum RMSE is 0.38 | Graphical and Topological features were used for localisation | [34] |
AR based Navigation | 99 percent for indoor environment | 4 percent error rate | RCB-D camera, Augmented reality and SLAM system was used to provide the localisation and navigation in hybrid maps. | [45] |
Proposed navigation system | Maximum accuracy of 99 percent and minimum accuracy is 96 percent | 0.113 and 0.17 are the minimum and maximum root mean square error values. | Uses CSV files as source of reference data. Device camera, A Star algorithm and NNS are used for the localisation, routing and result visualizaton |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Singh, S.; Singh, J.; Shah, B.; Sehra, S.S.; Ali, F. Augmented Reality and GPS-Based Resource Efficient Navigation System for Outdoor Environments: Integrating Device Camera, Sensors, and Storage. Sustainability 2022, 14, 12720. https://doi.org/10.3390/su141912720
Singh S, Singh J, Shah B, Sehra SS, Ali F. Augmented Reality and GPS-Based Resource Efficient Navigation System for Outdoor Environments: Integrating Device Camera, Sensors, and Storage. Sustainability. 2022; 14(19):12720. https://doi.org/10.3390/su141912720
Chicago/Turabian StyleSingh, Saravjeet, Jaiteg Singh, Babar Shah, Sukhjit Singh Sehra, and Farman Ali. 2022. "Augmented Reality and GPS-Based Resource Efficient Navigation System for Outdoor Environments: Integrating Device Camera, Sensors, and Storage" Sustainability 14, no. 19: 12720. https://doi.org/10.3390/su141912720
APA StyleSingh, S., Singh, J., Shah, B., Sehra, S. S., & Ali, F. (2022). Augmented Reality and GPS-Based Resource Efficient Navigation System for Outdoor Environments: Integrating Device Camera, Sensors, and Storage. Sustainability, 14(19), 12720. https://doi.org/10.3390/su141912720