Semantics of Multimodal Social Interaction

Dear Colleagues,

The increasing complexity of modern human–computer systems and interfaces results in an increasing demand for intelligent social interaction that is natural to users and exploits the full potential of spoken and multimodal communication. Today’s users have high expectations and require real-time engagement with highly relevant personalized content in a way which is comparable to natural human behaviour, and with the ability to adapt to a user’s cognitive and emotional states. Many real-life interactive situations involve more than the exchange of information, decision making, or problem-solving; they involve a wide range of aspects related to feelings, emotions, social status, power, interpersonal relations, and context. A comprehensive account of these aspects in computational models of multimodal interaction may form the foundation for a new generation of interactive social systems.

Over the past decade, a substantial amount of research has been devoted to the understanding of mechanisms governing multimodal social interaction. This Special Issue aims at presenting interdisciplinary research at the interface of artificial intelligence, computational linguistics, psycholinguistics, cognitive science, and human–computer interaction, focussing on the semantic and cognitive modelling of human social multimodal behaviour.

We invite contributions that deal with the modelling of human social behaviour and its interpretation. Topics range from multimodal behaviour recognition and social signals processing, analysis and annotation of multimodal interactive patterns, and semantic and pragmatic interpretation of multimodal interactive behaviour, to computational models of social cognition and multimodal dialogue.

Dr. Volha Petukhova
Prof. Harry Bunt
Prof. Laurent Prévot
Guest Editors

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Multimodal Technologies and Interaction is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 1600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

• Semantics and pragmatics of multimodal dialogue
• Interpretation and reasoning in multimodal dialogue systems
• Multimodal behaviour in social interaction: recognition, annotation, and analysis
• Datasets, tools, and methodology
• Multimodal dialogue modelling and management
• Multimodal dialogue and social interactive systems
• Cognitive modelling and multimodal interaction
• Machine learning for multimodal interaction
• Natural language interfaces for human–computer interaction
• Multimodal behaviour interpretation and generation
• New modalities and `beyond desktop' interfaces
• Social multimodal interaction and industrial challenges