Techniques and Applications of Augmented Reality Audio

A special issue of Applied Sciences (ISSN 2076-3417). This special issue belongs to the section "Acoustics and Vibrations".

Deadline for manuscript submissions: closed (20 February 2023) | Viewed by 3350

Special Issue Editors


E-Mail Website
Guest Editor
Audiovisual Signal Processing Laboratory, Ionian University, Plateia Tsirigoti 7, GR-491 00 Corfu, Greece
Interests: analysis; processing and conversion of digital audio signals; intelligent digital audio effects and sound synthesis; creative intelligence; audio-only games; auditory interfaces and displays; augmented reality audio foundations and applications; sound events impact on human emotions
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Audiovisual Signal Processing Laboratory, Ionian University, Plateia Tsirigoti 7, GR-491 00 Corfu, Greece
Interests: augmented reality audio; audio games; instructional design, gamification; data sonification; electronic music synthesis; electronic music performance; cultural heritage/gaming tourism
Special Issues, Collections and Topics in MDPI journals

E-Mail Website
Guest Editor
Audiovisual Signal Processing Laboratory, Ionian University, Plateia Tsirigoti 7, GR-491 00 Corfu, Greece
Interests: augmented reality; audiovisual; virtual reality; audio signal processing
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

Augmented reality audio (ARA) is a rapidly growing area of research and development. ARA technologies have now been adopted in many fields, such as accessibility, games, education, cultural heritage, navigation, healthcare, music, and entertainment.

ARA aims to provide users with immersive and interactive experiences by enhancing the real world with virtual information without isolating them from their environment. The legacy ARA practices focus mostly on a static mix of pseudo-acoustic environments and on passive modes of user participation. New techniques in terms of auditory perception and multimodal interaction are needed for the realization of more realistic and complex ARA scenarios and applications.

In this context, this Special Issue aims to introduce potential recent developments in ARA techniques and applications, thus providing insights into the field’s future directions of research and development.

Research topics of interest include, but are not limited to, the following:

  • Techniques for ARA mixing;
  • ARA Psychoacoustics;
  • ARA spatialization and perception;
  • ARA applications;
  • Interactive ARA;
  • Tracking techniques and systems for ARA environments;
  • Acoustic synthesis for sound event representation;
  • Augmented auditory interfaces;
  • Augmented audio-only games;
  • Wearable ARA technology;
  • Artificial/Creative intelligence and ARA;
  • Interactive storytelling for ARA environments;
  • ARA assistive technologies.

Prof. Dr. Andreas Floros
Dr. Emmanouel Rovithis
Dr. Nikolaos Moustakas
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Applied Sciences is an international peer-reviewed open access semimonthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2400 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Keywords

  • multimodal interaction techniques
  • auditory perception in ARA environments
  • spatial / 3D audio
  • wearable ARA technology
  • recording and playback ARA techniques
  • evaluation methodologies
  • binaural reproduction
  • ARA applications
  • hearing aid
  • AI in ARA
  • ARA mix
  • ARA experience design
  • interactive storytelling
  • assistive listening

Published Papers (2 papers)

Order results
Result details
Select all
Export citation of selected articles as:

Research

16 pages, 2295 KiB  
Article
An Algorithm for Generating Virtual Sources in Dynamic Virtual Auditory Display Based on Tensor Decomposition of Head-Related Impulse Responses
by Tong Zhao, Bosun Xie and Jun Zhu
Appl. Sci. 2022, 12(15), 7715; https://doi.org/10.3390/app12157715 - 31 Jul 2022
Viewed by 947
Abstract
Dynamic virtual auditory displays (VADs) are increasingly used for generating various auditory objects and scenes in virtual and augmented reality. Dynamic VADs are required to generate virtual sources in various directions and distances by using HRTF- or HRIR-based binaural synthesis. In the present [...] Read more.
Dynamic virtual auditory displays (VADs) are increasingly used for generating various auditory objects and scenes in virtual and augmented reality. Dynamic VADs are required to generate virtual sources in various directions and distances by using HRTF- or HRIR-based binaural synthesis. In the present work, an algorithm for improving the efficiency and performance of binaural synthesis in dynamic VAD is proposed. Based on tensor decomposition, a full set of near-field HRIRs is decomposed as a combination of distance-, direction-, and time-related modes. Then, binaural synthesis in VAD can be implemented by a common set of time mode-related convolvers or filters associated with direction- and distance-related weights. Dynamic binaural signals are created by updating the weights rather than updating the HRIR-based convolvers, which enables the independent control of virtual source distance and direction and avoids the audible artifact caused by updating the HRIR-based convolvers. An example of implementation indicates that a set of eight common convolvers or filters for each ear is enough to synthesize the binaural signals with sufficient accuracy. The computational efficiency of simultaneously generating multiple virtual sources is improved when the number of virtual sources is larger than eight. A virtual-source localization experiment validates the algorithm. Full article
(This article belongs to the Special Issue Techniques and Applications of Augmented Reality Audio)
Show Figures

Figure 1

21 pages, 537 KiB  
Article
Design Dimensions of Co-Located Multi-Device Audio Experiences
by David Geary, Jon Francombe, Kristian Hentschel and Damian Murphy
Appl. Sci. 2022, 12(15), 7512; https://doi.org/10.3390/app12157512 - 26 Jul 2022
Cited by 2 | Viewed by 1586
Abstract
The widespread distribution of mobile computing presents new opportunities for the consumption of interactive and immersive media experiences using multiple connected devices. Tools now exist for the creation of these experiences; however, there is still limited understanding of the best design practices and [...] Read more.
The widespread distribution of mobile computing presents new opportunities for the consumption of interactive and immersive media experiences using multiple connected devices. Tools now exist for the creation of these experiences; however, there is still limited understanding of the best design practices and use cases for the technology, especially in the context of audio experiences. In this study, the application space of co-located multi-device audio experiences is explored and documented through a review of the literature and a survey. Using the obtained information, a set of seven design dimensions that can be used to characterise and compare experiences of this type is proposed; these are synchronisation, context, position, relationship, interactivity, organisation, and distribution. A mapping of the current application space is presented where four categories are identified using the design dimensions, these are public performances, interactive music, augmented broadcasting, and social games. Finally, the overlap between co-located multi-device audio and audio-augmented reality (AAR) experiences is highlighted and discussed. This work will contribute to the wider discussion about the role of multiple devices in audio experiences and provide a source of reference for the design of future multi-device audio experiences. Full article
(This article belongs to the Special Issue Techniques and Applications of Augmented Reality Audio)
Show Figures

Figure 1

Back to TopTop