Multimodal Human-Computer Interaction

Dear Colleagues,

Humans interact with one another using different senses. These capacities enable them to absorb information so that it can be interpreted and transmitted information to others. For instance, in human-to-human conversation, one interlocutor speaks and makes gestures to transmit a message, while the other uses the senses of hearing and sight to capture and interpret that message. Just as humans communicate and interact with each other, these senses and mechanisms might be used to interact with computers. Human-to-human communication provides a natural feeling of interaction, unlike interaction with a computer somehow does not, with primary interactions with computers nowadays being mostly oriented towards mouse use, keyboard and touch in mobile devices.

Each day that passes brings us a step closer to accomplishing more natural and intuitive ways of interaction with machines, including gestures, speech, touch, and facial expressions. Evolving technologies (e.g., deep learning and IoT) are allowing, as of today, humans to accomplish what some years ago were scenes from sci-fi cinema, such as having an intelligent personal assistant capable of interacting using voice and gestures. This evolution will continue to bring us new and increasingly evolved technologies that are very intuitive and fun.

Nowadays, several technologies exist that enable the creation of different modalities with the capability of interacting with machines in different ways. Furthermore, input modalities can be combined, and different inputs (fusion) from different modalities can create new meaning when used together. Also, two different output modalities can present information in complementary fashion (via fission).

This Special Issue aims to bring together prominent researchers, experts, and practitioners in the field to share their insights and findings, fostering a comprehensive understanding of the current state of the art. Potential topics include but are not limited to (alphabetical order):

• Multimodal interaction
• Technologies for new modalities
• Speech-based interaction
• Gestural interfaces
• Virtual reality
• Assistants
• Interaction for IoT ecossystems
• Smart environments (homes, buildings, cities)
• Modality fusion
• Fission
• Applications
• Evaluation
• Context and user awareness and adaptation
• Tools for developers
• Human robot interaction
• Interaction with multi-device systems
• Migratory interfaces
• User-centered design
• Artificial intelligence tools and methods (for multimodal interaction)

Dr. Nuno Almeida
Prof. Dr. Samuel Silva
Prof. Dr. António Joaquim da Silva Teixeira
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Information is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

• human–computer interaction
• multimodal interaction
• fusion of modalities
• fission
• multi-device application
• assistants