Interactive Indoor Audio-Map as a Digital Equivalent of the Tactile Map
Abstract
1. Introduction
2. Materials and Methods
2.1. Literature Analysis
2.1.1. Selected Challenges in Creating Tactile Maps
2.1.2. Technologies That Improve Spatial Awareness for Blind and Visually Impaired People
2.1.3. Geoinformation Applications Supporting the Blind and Visually Impaired Users
2.1.4. Comparison of Products That Improve Spatial Awareness for Blind and Visually Impaired People
2.2. Description of the Audio-Map WUT Application Concept
2.2.1. The Concept of Geo-Descriptions
2.2.2. Meeting the WCAG Requirements
3. Results
3.1. Software Architecture
- Mobile Application—Audio-Map WUT mobile application implemented in Kotlin programming language;
- ArcGIS Runtime SDK for Android (version 100.15.0)—A software library dedicated to Android for map display and integration with various ArcGIS services;
- External database and services—A backend system that was developed as part of the “Building Accessibility Maps” project implemented at Warsaw University of Technology from 2022 to 2023.
3.2. Implementation Technology
3.3. Description of the Functions and Operation of the Audio-Map WUT Application
3.4. Preliminary Verification of the Correctness of the Concept
4. Discussion
4.1. Discussion of the Results
- Traditional tactile map;
- Currently available electronic solutions using sound as a means of communication;
- Proposed solutions.
- The ability to significantly increase the scope of geo-information presented to the user;
- Automatic delivery and updating of data;
- Enabling interaction with the map by providing content dependent on the point indicated on the map.
- High level of interactivity provided by smooth reading of the information displayed when the user swipes his finger on the smartphone screen;
- Facilitating the creation of a mental map of the building by providing descriptions at several levels of detail (generalization) and different spatial scopes (local and area geo-descriptions);
- Enabling building navigation (navigation geo-descriptions);
- The ability to provide and update geo-information online;
- Much wider range of geo-information delivered than in the case of a traditional tactile map (basically unlimited);
- High level of customization (choice of communication channel and interface operation methods: audio, text, use of TTS (text to speech) or Google Talkback).
- Limited ability to present the 3rd dimension in a convenient way (at the current stage of application development);
- Potential failures (network problems, server failures).
4.2. A Forward-Looking Perspective
- Single click—reading a location geo-description;
- Double click—reading the navigation geo-description;
- Long click—reading a cognitive geo-description.
- Gentle and long vibrations—enclosed rooms (e.g., laboratory, toilet, office);
- Pulsating vibrations (a series of short vibrations in a specific rhythm)—corridors;
- Short and intense vibrations—dangerous places (e.g., stairs, high thresholds).
- Slow finger swiping—slow reading of space descriptions;
- Fast finger swiping—fast reading of space descriptions.
- Slow finger swiping—reading cognitive geo-descriptions;
- Fast finger swiping—reading location geo-descriptions.
- Tilting the smartphone forward—simulating acceleration of movement (faster geo-description reading);
- Tilting the smartphone backwards—simulation of slowing down movement (slower reading of geo-descriptions).
5. Conclusions
- At present, there are very good technological opportunities to provide visually impaired people with solutions to help them navigate much more than before using traditional tactile maps;
- Emerging new solutions are based on combining several ways of conveying information: tactile, audio and haptic which seems to be the right trend;
- The proposed solution supporting people with disabilities can also be useful and attractive to all users of navigation applications and may affect the development of such applications.
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Olczyk, M. The rules of developing tactile maps for blind and visually impaired. Pol. Cartogr. Rev. 2014, 46, 432–442. [Google Scholar]
- Świech, H. Prototype of a Mobile Application Supporting Spatial Orientation Inside Buildings, with Special Attention to the Needs of Blind People. Unpublished. Bachelor’s Thesis, Warsaw University of Technology, Warsaw, Poland, 2023. [Google Scholar]
- Rowell, J.; Ungar, S. Feeling Our Way: Tactile Map User Requirements—A Survey. In Proceedings of the ICA 2005, New York City, NY, USA, 26–30 May 2005. [Google Scholar]
- Kent, A.J. Maps, Materiality and Tactile Aesthetics. Cartogr. J. 2019, 56, 1–3. [Google Scholar] [CrossRef]
- Wabiński, J.; Mościcka, A. Automatic (Tactile) Map Generation—A Systematic Literature Review. ISPRS Int. J. Geo-Inf. 2019, 8, 293. [Google Scholar] [CrossRef]
- Wabiński, J.; Mościcka, A.; Kuźma, M. The Information Value of Tactile Maps: A Comparison of Maps Printed with the Use of Different Techniques. Cartogr. J. 2020, 58, 30. [Google Scholar] [CrossRef]
- Wabiński, J.; Mościcka, A.; Touya, G. Guidelines for Standardizing the Design of Tactile Maps: A Review of Research and Best Practice. Cartogr. J. 2022, 59, 239–258. [Google Scholar] [CrossRef]
- Wabiński, J.; Araszkiewicz, A.; Mościcka, A.; Śmiechowska-Petrovskij, E.; Kiliszek, D. UV Printed Tactile Maps of Historic Parks. Agil. GISci. Ser. 2024, 5, 50. [Google Scholar] [CrossRef]
- Swathi, K.; Gayathri, P.; Manasa, D.; Pavani, G.; Likhitha, B. Smart Glasses for Visually Impaired People Using IoT. Int. Res. J. Adv. Eng. Manag. 2024, 2, 1390–1394. [Google Scholar] [CrossRef]
- Mitruț, O.; Butean, A. Designing 3D Audio and Haptic Interfaces for Training the Sound Localization Ability of the Visually Impaired People. Bull. Polytech. Inst. Iași 2014, 50, 87–94. [Google Scholar]
- Engel, C.; Weber, G. ATIM: Automated Generation of Interactive, Audio-Tactile Indoor Maps by Means of a Digital Pen. In Proceedings of the Computers Helping People with Special Needs, Lecco, Italy, 11–15 July 2022. [Google Scholar] [CrossRef]
- Barvíř, R.; Vondráková, A.; Brus, J. TouchIt3D: Technology (Not Only) for Tactile Maps. Abstr. ICA 2019, 1, 24. [Google Scholar] [CrossRef]
- Altenaa, V.; Rijnberk, D.; Kuijer, M.; Jansen, C.; Min, E.; Welbergen, C.; Visser, T.; Vaart, E.; Nauta, F. Tailoring Tactile Maps Based on Blind Users’ Needs. Proc. ICA 2023, 5, 22. [Google Scholar] [CrossRef]
- Gkanidi, M.; Drigas, A. Tactile Maps and New Technologies for Blind and People with Visual Impairments. Int. J. Manag. Humanit. 2021, 5, 1–9. [Google Scholar] [CrossRef]
- Papadopoulos, K.; Koustriava, E.; Koukourikos, P.; Kartasidou, L.; Barouti, M.; Varveris, A.; Misiou, M.; Zacharogeorga, T.; Anastasiadis, T. Comparison of three orientation and mobility aids for individuals with blindness: Verbal description, audio-tactile map and audio-haptic map. Assist. Technol. 2016, 29, 1–7. [Google Scholar] [CrossRef] [PubMed]
- Papadopoulos, K.; Koukourikos, P.; Koustriava, E.; Marina, M.; Asimis, V.; Valari, E. Audio-Haptic Map: An Orientation and Mobility Aid for Individuals with Blindness. Procedia Comput. Sci. 2015, 67, 223–230. [Google Scholar] [CrossRef][Green Version]
- Calle-Jimenez, T.; Luján-Mora, S.; Arias-Flores, H.; Ramos, C.; Nunes, I.L. Designing Accessible Maps on Mobile Devices for Blind and Visually Impaired Users. Adv. Ind. Des. 2020, 1202, 110–116. [Google Scholar] [CrossRef]
- Götzelmann, T.; Winkler, K. SmartTactMaps: A Smartphone-Based Approach to Support Blind Persons in Exploring Tactile Maps. In Proceedings of the 8th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Corfu, Greece, 1–3 July 2015; Volume 2, pp. 1–8. [Google Scholar] [CrossRef]
- Science in Poland. Newly Developed Tactile Maps for the Blind Will Be Used More for Navigation. Available online: https://scienceinpoland.pl/en/news/news%2C96444%2Cnewly-developed-tactile-maps-blind-will-be-used-more-navigation.html (accessed on 2 July 2025).
- ArcGIS StoryMaps. Methods on Creating a Tactile Map for Lawton Public Library. Available online: https://storymaps.arcgis.com/stories/7150df6e8d3b4535bfcf5226f068942b (accessed on 2 July 2025).
- Science in Poland. Students Create Photo-to-Braille Translator for the Blind. Available online: https://scienceinpoland.pl/en/news/news%2C97150%2Cstudents-create-photo-braille-translator-blind.html (accessed on 2 July 2025).
- Esri. Tactile Maps Built with GIS Help People Who Are Blind Gain Spatial Awareness. Available online: https://www.esri.com/about/newsroom/arcnews/tactile-maps-built-with-gis-help-people-who-are-blind-gain-spatial-awareness/ (accessed on 2 July 2025).
- Direct Access. Tactile and Sensory Maps. Available online: https://directaccessgp.com/uk/media/tactile-and-sensory-maps (accessed on 2 July 2025).
- Cieslik, E. Accessibility and Exhibit Safety: The Importance of Sensory Maps. Collect. A J. Mus. Arch. Prof. 2024, 20, 365–384. [Google Scholar] [CrossRef]
- Gotlib, D.; Świech, H. Building Accessibility Maps: Cartographic Solutions to Assist Mobility of People with Disabilities. In Proceedings of the 31st International Cartographic Conference (ICC 2023), Cape Town, South Africa, 13–18 August 2023. [Google Scholar] [CrossRef]
- Gotlib, D.; Świech, H. Selected issues of the design and implementation process of mobile applications using text and voice geospatial description on the example of “Accessibility Map of Buildings”. Rocz. Geomat. 2023, 21, 7–29. [Google Scholar]
- Lipka, K.; Gotlib, D.; Choromański, K. The Use of Language Models to Support the Development of Cartographic Descriptions of a Building’s Interior. Appl. Sci. 2024, 14, 9343. [Google Scholar] [CrossRef]
- Khusro, S.; Shah, B.; Khan, I.; Rahman, S. Haptic Feedback to Assist Blind People in Indoor Environment Using Vibration Patterns. Sensors 2022, 22, 361. [Google Scholar] [CrossRef] [PubMed]
- Azenkot, S.; Ladner, R.E.; Wobbrock, J.O. Smartphone haptic feedback for nonvisual wayfinding. In Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2011), Dundee, UK, 24–26 October 2011. [Google Scholar] [CrossRef]
Product Type | Information Medium | Main Features and Example of Functionality |
---|---|---|
audio-haptic map | sound, haptic forms of touch | A mobile application that helps users navigate by generating audio descriptions of the space, such as descriptions of the user’s location and route directions, and by using vibrations to indicate direction of movement, distance to the destination, and obstacles along the route. |
audio-tactile map | sound, various forms of touch | A map with physical, convex, tactile elements and with sounds describing these elements. This could be a tactile map combined with sensors that activate sound when the element is touched or when a receiving device (such as an NFC reader) is brought close. |
sound map | sound | A mobile application that provides visually impaired users with navigation guidance in the form of audio messages generated based on the location of the smartphone as determined by a GNSS receiver. |
sensory map | touch, sound, sight | A map with physical, convex elements, Braille text, contrasting colors and sounds describing different areas of the map. |
audio guide | sound | A virtual guide to the museum describing the exhibits in the user’s immediate vicinity. |
Geo-Description Type | Spatial Coverage | Explanation | Example |
---|---|---|---|
Local | refer to a specific place (e.g., entrance) and room | The geo-description contains information about what the immediate surroundings of the selected location look like | You are at the beginning of the cloisters surrounding the Main Auditorium on the third floor. You are at the junction of two corridors near the entrance to the main offices of the Geodesy and Cartography Faculty |
Zones | relate to floors, wings/sections of the building | The geo-description includes such information as the range of numbers in a given part of the building, the name of the part, and the function. | You are on the first floor in the northern part with the staff offices. The numbering in this part of the building starts with 120 and ends with 144. |
Area | relate to the entire building or its surroundings giving spatial context | The geo-description includes such information as the number of floors, the name of the building, the function of the building. For the blind, information is provided on the appearance of the building (e.g., a glass building, a historic building in the neoclassical style), and for people with physical disabilities, information on how to reach the entrance adapted for them | The building has an irregular shape, in which the northern and southern parts can be distinguished. The main entrance to the building is on the east side. The southern part has teaching rooms, and the northern part has staff offices. The southern part has two floors, and the northern part has four floors. |
ID | Testers/Users’ Comments |
---|---|
1 | The testers responded positively to the idea of presenting the WUT campus using an interactive map. They were particularly interested in exploring the spatial relationships between buildings, the layout of rooms, the list of floors, and the means of navigating between different zone |
2 | The testers noted issues with the repetition of announcements, the inability to replay messages, and difficulties in relocating previously explored areas on the map. However, the content, length, and overall quality of the announcements were evaluated positively. Testers understood the purpose of each message and the characteristics of the described sections, rooms, etc. |
3 | The testers responded positively to the idea of presenting the WUT campus using an interactive map. They were particularly interested in exploring the spatial relationships between buildings, the layout of rooms, the list of floors, and the means of navigating between different zone |
4 | The geodescriptions themselves were positively evaluated. The level of detail was deemed appropriate. Messages concerning buildings, floors, and zones were described as concise and informative, often including useful hints such as which rooms are located in particular areas or what amenities are available on certain floors. One participant expressed satisfaction with having access to both general information about the building’s appearance and potential obstacles, such as book carts positioned in the reading room. |
5 | When asked whether she would like to familiarize herself with the building map before visiting, the tester answered affirmatively, stating it would be very helpful. She suggested it would be more convenient to explore the building using the app on a larger screen. |
6 | The testers recommended maximizing the map view at the expense of the interface to facilitate better exploration of the displayed areas. |
7 | After searching for an object using the search engine, the message read aloud does not include the object’s location in relation to the zone, floor, or building. |
8 | A major difficulty reported by all testers was independently locating doors. QR codes are too small to be read by the camera from various points in the corridor. Given these issues, QR codes should be treated solely as a complementary solution to beacon-based navigation, for example, to verify a room number. |
9 | The majority of completely blind users use iPhones. The iPhone is considered easier to use and less distracting. Therefore, the primary recommendation is to accelerate the development of the iOS version. |
10 | Testers suggested that in this mode, the application should initially present a full view of the WUT campus. The entire campus should be visible on screen, and dragging a finger across it should identify which building is underneath. To help users remember building locations, this screen should remain static—without the ability to zoom, rotate, or shift the map. |
11 | Testers recommended that all users—blind, visually impaired, and sighted—should interact with the same interface. This approach would facilitate knowledge-sharing between users with and without disabilities and would also reduce development and maintenance efforts. |
12 | Testers proposed the inclusion of two user modes: Exploration Mode and Navigation Mode. In Exploration Mode, the application should deliver detailed messages describing individual parts of the campus. In Navigation Mode, messages should be concise, assuming the user has already familiarized themselves with the campus and the layout of areas of interest. |
13 | Testers experienced difficulties using TalkBack and VoiceOver for reading the map and interacting with some oversized interface elements, as well as due to existing user habits. |
14 | The interface’s audio feedback functioned differently than what the tester was accustomed to (VoiceOver in iOS). Touching a button triggered its immediate activation, without the opportunity to review available button labels beforehand. As a result, the user switched between functions in a disorganized manner and was unable to “take control” of the application. |
15 | Testers pointed out the need to optimize zoom functionality. |
Feature | Traditional Tactile Map | Electronic Products Currently Available to Assist People with Visual Impairments | Proposed Solution |
---|---|---|---|
Type of recipient | blind, visually impaired | blind, visually impaired, sensory disability, epilepsy, PTSD, person without disability | blind, visually impaired, sensory disability, person without disabilities |
Information medium | touch, sight | touch, sound, sight | touch, sound, sight |
Physical form | yes | in some products | no |
Mobility | usually none | mostly limited | full |
Risk of failure | small (physical damage) | moderate (physical damage, network problems, server failures) | moderate (network problems, server failures) |
Scope of information | very limited | average | wide |
Content type | static | dynamic | dynamic |
Data update | none (usually the need to replace the entire map) | dependent on specific product—partial online update possible | online |
Interactivity | no | from small to high depending on the specific product | high |
Supporting mental map creation and spatial orientation training | limited | moderate | high |
Customizable | no | limited | fully |
Popularity | high | moderate | small (just being introduced into use) |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Gotlib, D.; Lipka, K.; Świech, H. Interactive Indoor Audio-Map as a Digital Equivalent of the Tactile Map. Appl. Sci. 2025, 15, 8975. https://doi.org/10.3390/app15168975
Gotlib D, Lipka K, Świech H. Interactive Indoor Audio-Map as a Digital Equivalent of the Tactile Map. Applied Sciences. 2025; 15(16):8975. https://doi.org/10.3390/app15168975
Chicago/Turabian StyleGotlib, Dariusz, Krzysztof Lipka, and Hubert Świech. 2025. "Interactive Indoor Audio-Map as a Digital Equivalent of the Tactile Map" Applied Sciences 15, no. 16: 8975. https://doi.org/10.3390/app15168975
APA StyleGotlib, D., Lipka, K., & Świech, H. (2025). Interactive Indoor Audio-Map as a Digital Equivalent of the Tactile Map. Applied Sciences, 15(16), 8975. https://doi.org/10.3390/app15168975