Skip to Content

81 Results Found

  • Article
  • Open Access
12 Citations
4,171 Views
15 Pages

MMATERIC: Multi-Task Learning and Multi-Fusion for AudioText Emotion Recognition in Conversation

  • Xingwei Liang,
  • You Zou,
  • Xinnan Zhuang,
  • Jie Yang and ,
  • Taiyu Niu and
  • Ruifeng Xu
  • + 1 author+ 0 author

The accurate recognition of emotions in conversations helps understand the speaker’s intentions and facilitates various analyses in artificial intelligence, especially in human–computer interaction systems. However, most previous methods need more ab...

(This article belongs to the Special Issue Applied AI in Emotion Recognition)
  • Article
  • Open Access
4 Citations
3,553 Views
18 Pages

Domain Adversarial Network for Cross-Domain Emotion Recognition in Conversation

  • Hongchao Ma,
  • Chunyan Zhang,
  • Xiabing Zhou,
  • Junyi Chen and
  • Qinglei Zhou

27 May 2022

Emotion Recognition in Conversation (ERC) aims to recognize the emotion for each utterance in a conversation automatically. Due to the difficulty of collecting and labeling, this task lacks the dataset corpora available on a large scale. This increas...

(This article belongs to the Special Issue Advances in Artificial Intelligence Methods for Natural Language Processing)
  • Article
  • Open Access
7 Citations
4,216 Views
18 Pages

Adaptive Graph Learning with Multimodal Fusion for Emotion Recognition in Conversation

  • Jian Liu,
  • Jian Li,
  • Jiawei Dong,
  • Zifan Mo and ,
  • Na Liu,
  • Qingdu Li and
  • Ye Yuan
  • + 2 authors+ 0 author

Robust emotion recognition is a prerequisite for natural, fluid human–computer interaction, yet conversational settings remain challenging because emotions are shaped simultaneously by global topic flow and local speaker-to-speaker dependencies...

(This article belongs to the Section Bioinspired Sensorics, Information Processing and Control)
  • Article
  • Open Access
1,506 Views
29 Pages

23 March 2026

Multimodal Emotion Recognition in Conversation (ERC) has attracted attention as a key technology in human–computer interaction, mental healthcare, and intelligent services. However, deploying ERC in real-world settings remains challenging due t...

(This article belongs to the Special Issue Multimodal Emotion Recognition and Affective Computing)
  • Article
  • Open Access
681 Views
20 Pages

Task-Adaptive and Multi-Level Contextual Understanding for Emotion Recognition in Conversations

  • Xiaomeng Yao,
  • Wei Cao,
  • Yuyang Xue,
  • Haijun Zhang and
  • Xiaochao Fan

9 February 2026

Emotion recognition in conversations (ERC) is a significant task in natural language processing, aimed at identifying the emotion of each utterance within a conversation. Current research predominantly relies on pre-trained language models, often inc...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
13 Citations
4,397 Views
15 Pages

Multimodal Emotion Recognition in Conversation Based on Hypergraphs

  • Jiaze Li,
  • Hongyan Mei,
  • Liyun Jia and
  • Xing Zhang

19 November 2023

In recent years, sentiment analysis in conversation has garnered increasing attention due to its widespread applications in areas such as social media analytics, sentiment mining, and electronic healthcare. Existing research primarily focuses on sequ...

(This article belongs to the Special Issue Applied AI in Emotion Recognition)
  • Article
  • Open Access
4 Citations
3,718 Views
16 Pages

28 January 2023

Emotion recognition in multi-party conversations (ERMC) is becoming increasingly popular as an emerging research topic in natural language processing. Recently, many approaches have been devoted to exploiting inter-dependency and self-dependency amon...

(This article belongs to the Special Issue Audio, Speech and Language Processing)
  • Article
  • Open Access
6 Citations
3,532 Views
16 Pages

11 November 2025

To comprehensively capture conversational emotion information within and between modalities, address the challenge of global and local feature modelling in conversation, and enhance the accuracy of multimodal conversation emotion recognition, we pres...

  • Review
  • Open Access
38 Citations
13,263 Views
28 Pages

20 November 2023

As a branch of sentiment analysis tasks, emotion recognition in conversation (ERC) aims to explore the hidden emotions of a speaker by analyzing the sentiments in utterance. In addition, emotion recognition in multimodal data from conversation includ...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
2 Citations
1,889 Views
24 Pages

Scene-Speaker Emotion Aware Network: Dual Network Strategy for Conversational Emotion Recognition

  • Bingni Li,
  • Yu Gu,
  • Chenyu Li,
  • He Zhang and ,
  • Linsong Liu,
  • Haixiang Lin and
  • Shuang Wang
  • + 2 authors+ 0 author

Incorporating external knowledge has been shown to improve emotion understanding in dialogues by enriching contextual information, such as character motivations, psychological states, and causal relations between events. Filtering and categorizing th...

(This article belongs to the Special Issue Image and Signal Processing Techniques and Applications)
  • Feature Paper
  • Article
  • Open Access
110 Citations
12,348 Views
17 Pages

19 July 2021

Decades of scientific research have been conducted on developing and evaluating methods for automated emotion recognition. With exponentially growing technology, there is a wide range of emerging applications that require emotional state recognition...

(This article belongs to the Special Issue Sensor Based Multi-Modal Emotion Recognition)
  • Article
  • Open Access
11 Citations
6,128 Views
16 Pages

22 December 2022

Emotion recognition in conversation (ERC) is receiving more and more attention, as interactions between humans and machines increase in a variety of services such as chat-bot and virtual assistants. As emotional expressions within a conversation can...

(This article belongs to the Special Issue Machine Learning in Pattern Recognition)
  • Article
  • Open Access
6 Citations
2,783 Views
30 Pages

Emotion recognition in conversations (ERC), which aims to capture the dynamic changes in emotions during conversations, has recently attracted a huge amount of attention due to its importance in providing engaging and empathetic services. Considering...

(This article belongs to the Section Artificial Intelligence)
  • Article
  • Open Access
5 Citations
2,945 Views
18 Pages

10 March 2023

Daily conversations contain rich emotional information, and identifying this emotional information has become a hot task in the field of natural language processing. The traditional dialogue sentiment analysis method studies one-to-one dialogues and...

(This article belongs to the Special Issue Natural Language Processing (NLP) and Applications)
  • Article
  • Open Access
530 Views
28 Pages

20 July 2026

Despite the rapid advancement of Emotion Recognition in Conversation (ERC), prevailing systems that primarily integrate language and speech exhibit substantial performance disparities on underrepresented emotion classes (e.g., Fear, Disgust). This st...

(This article belongs to the Special Issue Innovative Intelligent Systems in Computer Vision: Methodologies, Algorithms, and Applications)
  • Article
  • Open Access
5 Citations
2,546 Views
21 Pages

HGF-MiLaG: Hierarchical Graph Fusion for Emotion Recognition in Conversation with Mid-Late Gender-Aware Strategy

  • Yihan Wang,
  • Rongrong Hao,
  • Ziheng Li,
  • Xinhe Kuang and ,
  • Jiacheng Dong,
  • Qi Zhang,
  • Fengkui Qian and
  • Changzeng Fu
  • + 3 authors+ 0 author

14 February 2025

Emotion recognition in conversation (ERC) is an important research direction in the field of human-computer interaction (HCI), which recognizes emotions by analyzing utterance signals to enhance user experience and plays an important role in several...

(This article belongs to the Special Issue Deep Learning for Perception and Recognition: Method and Applications)
  • Article
  • Open Access
13 Citations
6,858 Views
21 Pages

Multimodal Emotional Classification Based on Meaningful Learning

  • Hajar Filali,
  • Jamal Riffi,
  • Chafik Boulealam,
  • Mohamed Adnane Mahraz and
  • Hamid Tairi

Emotion recognition has become one of the most researched subjects in the scientific community, especially in the human–computer interface field. Decades of scientific research have been conducted on unimodal emotion analysis, whereas recent co...

  • Article
  • Open Access
4 Citations
5,178 Views
37 Pages

Emotion and Intention Detection in a Large Language Model

  • Emmanuel Castro,
  • Hiram Calvo and
  • Olga Kolesnikova

24 November 2025

Large language models (LLMs) have recently shown remarkable capabilities in natural language processing. In this work, we investigate whether an advanced LLM can recognize user emotions and intentions from text, focusing on the open-source model Deep...

(This article belongs to the Special Issue Mathematical Foundations in NLP: Applications and Challenges)
  • Article
  • Open Access
11 Citations
8,503 Views
18 Pages

11 April 2025

Embodied conversational agents (ECAs) are autonomous interaction interfaces designed to communicate with humans. This study investigates the impact of response delays and emotional facial expressions of ECAs on user perception and engagement. The mot...

(This article belongs to the Special Issue Human–Computer Interaction and Virtual Environments)
  • Article
  • Open Access
5 Citations
4,578 Views
14 Pages

19 April 2025

Sentiment analysis is pivotal in advancing human–computer interaction (HCI) systems as it enables emotionally intelligent responses. While existing models show potential for HCI applications, current conversational datasets exhibit critical lim...

  • Article
  • Open Access
3 Citations
1,839 Views
20 Pages

EmoBERTa–CNN: Hybrid Deep Learning Approach Capturing Global Semantics and Local Features for Enhanced Emotion Recognition in Conversational Settings

  • Mingfeng Zhang,
  • Aihe Yu,
  • Xuanyu Sheng,
  • Jisun Park and ,
  • Jongtae Rhee and
  • Kyungeun Cho
  • + 1 author+ 0 author

29 July 2025

Emotion recognition in conversations is a key task in natural language processing that enhances the quality of human–computer interactions. Although existing deep learning and Transformer-based pretrained language models have shown remarkably e...

(This article belongs to the Special Issue Computational Intelligence and Human–Computer Interaction: Modern Methods and Applications, 3rd Edition)
  • Article
  • Open Access
15 Citations
7,936 Views
15 Pages

27 April 2022

It is not an easy task for organizers to observe the engagement level of a video meeting audience. This research was conducted to build an intelligent system to enhance the experience of video conversations such as virtual meetings and online classro...

(This article belongs to the Special Issue 1st Online Conference on Algorithms (IOCA2021))
  • Article
  • Open Access
326 Views
21 Pages

2 September 2026

Speaker recognition models are typically enrolled using neutral speech, yet real users rarely speak under emotionally neutral conditions. Emotion alters prosody, spectral structure, articulation, and speaking rate, shifting utterances away from the a...

(This article belongs to the Special Issue Signal Processing and Machine Learning, 2nd Edition)
  • Article
  • Open Access
4 Citations
3,892 Views
21 Pages

Arabic Emotional Voice Conversion Using English Pre-Trained StarGANv2-VC-Based Model

  • Ali H. Meftah,
  • Yousef A. Alotaibi and
  • Sid-Ahmed Selouani

28 November 2022

The goal of emotional voice conversion (EVC) is to convert the emotion of a speaker’s voice from one state to another while maintaining the original speaker’s identity and the linguistic substance of the message. Research on EVC in the Ar...

(This article belongs to the Special Issue Audio, Speech and Language Processing)
  • Feature Paper
  • Article
  • Open Access
3 Citations
2,956 Views
13 Pages

Computer communication via text messaging or Social Networking Services (SNS) has become increasingly popular. At this time, many studies are being conducted to analyze user information or opinions and recognize emotions by using a large amount of da...

(This article belongs to the Special Issue Image Segmentation)
  • Article
  • Open Access
31 Citations
4,928 Views
23 Pages

21 January 2025

Emotion recognition is becoming increasingly important for accurately understanding and responding to user emotions, driven by the rapid proliferation of non-face-to-face environments and advancements in conversational AI technologies. Existing studi...

(This article belongs to the Special Issue Applications of Deep Learning and Artificial Intelligence Methods: 2nd Edition)
  • Article
  • Open Access
2 Citations
987 Views
20 Pages

Temporal Capsule Feature Network for Eye-Tracking Emotion Recognition

  • Qingfeng Gu,
  • Jiannan Chi,
  • Cong Zhang,
  • Boxiang Cao and ,
  • Jiahui Liu and
  • Yu Wang
  • + 1 author+ 0 author

18 December 2025

Eye Tracking (ET) parameters, as physiological signals, are widely applied in emotion recognition and show promising performance. However, emotion recognition relying on ET parameters still faces several challenges: (1) insufficient extraction of tem...

(This article belongs to the Section Behavioral Neuroscience)
  • Article
  • Open Access
686 Views
24 Pages

Exploring emotions in organization settings, particularly in feedback on organizational welfare programs, is critical for understanding employee experiences and enhancing organizational policies. Recognizing emotions from a conversation (i.e., leavin...

(This article belongs to the Section Computational Social Science)
  • Article
  • Open Access
4 Citations
3,103 Views
24 Pages

26 February 2024

The paper aims to develop an information system for human emotion recognition in streaming data obtained from a PC or smartphone camera, using different methods of modality merging (image, sound and text). The objects of research are the facial expre...

(This article belongs to the Special Issue Collaborative Learning and Optimization Theory and Its Applications)
  • Article
  • Open Access
1 Citations
2,059 Views
11 Pages

26 January 2025

Although the eye-tracking technique has been widely used to passively study emotion recognition, no studies have utilised this technique to actively manipulate eye-gaze strategies during the recognition facial emotions. The present study aims to fill...

(This article belongs to the Special Issue Recent Advances in Understanding Facial Expression Processing: New Methods, Measures and Models)
  • Article
  • Open Access
379 Views
18 Pages

10 August 2026

Speech emotion recognition (SER) is a fundamental task in affective computing; however, traditional unimodal approaches often struggle to capture the complex emotional cues present in spontaneous conversational speech. Bimodal frameworks that integra...

(This article belongs to the Special Issue Artificial Intelligence (AI) and Natural Language Processing (NLP))
  • Article
  • Open Access
7 Citations
5,653 Views
24 Pages

Impathy and Emotion Recognition: How Attachment Shapes Self- and Other-Focused Emotion Processing

  • Dirk W. Eilert,
  • Karin de Punder,
  • Jeff Maerz,
  • Johanna Dose and ,
  • Manuela Gander,
  • Philipp Mensah,
  • Stefanie Neubrand,
  • Josef Hinterhölzl and
  • Anna Buchheim
  • + 4 authors+ 0 author

Background/Objectives: Early attachment experiences and psychopathology both shape individuals’ emotion processing. However, the specific influence of adult attachment representations on self- (intrapersonal) and other-focused (interpersonal) e...

(This article belongs to the Section Cognitive, Social and Affective Neuroscience)
  • Article
  • Open Access
3 Citations
3,248 Views
22 Pages

3 October 2023

Emotion recognition and social inference impairments are well-documented features of post-traumatic brain injury (TBI), yet the mechanisms underpinning these are not fully understood. We examined dynamic emotion recognition, social inference abilitie...

(This article belongs to the Section Cognition)
  • Article
  • Open Access
1 Citations
1,148 Views
15 Pages

26 April 2025

The COVID-19 pandemic increased the number of video conferences, for example, through online teaching and home office meetings. Even in the medical environment, consultation sessions are now increasingly conducted in the form of video conferencing. T...

(This article belongs to the Special Issue Advances in Human-Centered Artificial Intelligence)
  • Article
  • Open Access
1 Citations
797 Views
35 Pages

Accurate and Robust Multimodal Emotion Recognition for Human–Robot Interaction via Dynamic Graph Learning with Pairwise Cross-Modal Alignment

  • Xinyang Zhou,
  • Jiahao Wu,
  • Hongming Xu,
  • Jinghan Mei and ,
  • Zeyang Chen,
  • Junxiong Zhang,
  • Yitong Chen,
  • Yanrui Jin,
  • Chengliang Liu and
  • Chenggang Yuan
  • + 5 authors+ 0 author

Multimodal emotion recognition in conversation (MERC) aims to identify the emotions in each utterance by modeling textual, acoustic, and visual evidence. Compared with unimodal emotion recognition in conversation (ERC), MERC can leverage complementar...

(This article belongs to the Special Issue Multimodal Deep Learning and Its Applications)
  • Article
  • Open Access
688 Views
27 Pages

17 December 2025

Emotional Footprint Identification refers to the process of recognizing or understanding the emotional impact that a person, experience, or interaction leaves on others. Emotion Recognition plays an important role in human–computer interaction...

  • Article
  • Open Access
10 Citations
2,585 Views
24 Pages

Conversational interactions, rich in both linguistic and vocal cues, provide a natural context for studying these processes. In this work, we propose an explainable multimodal transformer framework that integrates textual semantics (via RoBERTa) and...

(This article belongs to the Special Issue Social Cognition and Emotions)
  • Brief Report
  • Open Access
80 Citations
15,147 Views
22 Pages

Emotions are viewed as an important aspect of human interactions and conversations, and allow effective and logical decision making. Emotion recognition uses low-cost wearable electroencephalography (EEG) headsets to collect brainwave signals and int...

(This article belongs to the Special Issue Virtual Reality, Augmented Reality, and Human-Computer Interaction)
  • Article
  • Open Access
31 Citations
7,869 Views
24 Pages

Emotion Recognition Method for Call/Contact Centre Systems

  • Mirosław Płaza,
  • Robert Kazała,
  • Zbigniew Koruba,
  • Marcin Kozłowski and ,
  • Małgorzata Lucińska,
  • Kamil Sitek and
  • Jarosław Spyrka
  • + 2 authors+ 0 author

28 October 2022

Nowadays, one of the important aspects of research on call/contact centre (CC) systems is how to automate their operations. Process automation is influenced by the continuous development in the implementation of virtual assistants. The effectiveness...

(This article belongs to the Special Issue Artificial Intelligence in Industrial Engineering)
  • Article
  • Open Access
13 Citations
5,647 Views
12 Pages

13 April 2021

The use of affective speech in robotic applications has increased in recent years, especially regarding the developments or studies of emotional prosody for a specific group of people. The current work proposes a prosody-based communication system th...

(This article belongs to the Section Robotics and Automation)
  • Article
  • Open Access
40 Citations
9,552 Views
13 Pages

Emotion Recognition in Human–Robot Interaction Using the NAO Robot

  • Iro Athina Valagkouti,
  • Christos Troussas,
  • Akrivi Krouska,
  • Michalis Feidakis and
  • Cleo Sgouropoulou

Affective computing can be implemented across many fields in order to provide a unique experience by tailoring services and products according to each person’s needs and interests. More specifically, digital learning and robotics in education c...

(This article belongs to the Special Issue Interactive Technology and Smart Education)
  • Article
  • Open Access
5 Citations
2,721 Views
12 Pages

Speech Emotion Recognition Incorporating Relative Difficulty and Labeling Reliability

  • Youngdo Ahn,
  • Sangwook Han,
  • Seonggyu Lee and
  • Jong Won Shin

25 June 2024

Emotions in speech are expressed in various ways, and the speech emotion recognition (SER) model may perform poorly on unseen corpora that contain different emotional factors from those expressed in training databases. To construct an SER model robus...

(This article belongs to the Special Issue Sensors Applications on Emotion Recognition)
  • Feature Paper
  • Article
  • Open Access
5 Citations
2,740 Views
26 Pages

13 October 2025

We propose a multimodal emotion recognition framework that integrates facial expressions and speech transcription (where text is derived from the transcribed speech), with a particular focus on effectively modeling the continuous changes and transiti...

(This article belongs to the Special Issue Application of Data Mining in Social Media)
  • Case Report
  • Open Access
1 Citations
1,850 Views
18 Pages

In recent decades, technological advances have fostered new therapeutic approaches for children with neurodevelopmental disorders, particularly Autism Spectrum Disorder. Educational robotics has emerged as a promising resource for acquiring social sk...

  • Article
  • Open Access
4 Citations
3,310 Views
20 Pages

25 March 2025

In recent years, advancements in artificial intelligence, speech, and natural language processing technology have enhanced spoken dialogue systems (SDSs), enabling natural, voice-based human–computer interaction. However, discrete, token-based...

(This article belongs to the Special Issue Generative Artificial Intelligence in Smart Societies)
  • Article
  • Open Access
272 Views
22 Pages

CoMA: Condition-Modulated Context–Knowledge Attention for Empathetic Dialogue Generation

  • Kim Ngan Phan,
  • Soonja Yeom,
  • Hyung-Jeong Yang,
  • Seungwon Kim and ,
  • Ji-eun Shin and
  • Soo-Hyung Kim
  • + 1 author+ 0 author

9 October 2026

Empathetic response generation requires a model to balance emotional appropriateness with contextual grounding. However, the performance of emotion recognition remains relatively limited, which may lead to cascading errors in generating empathetic re...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
1 Citations
1,918 Views
25 Pages

This paper presents diaLogic, a humans-in-the-loop system for modeling the behavior of teams during collective problem solving. Team behavior is modeled using multi-modal data about cognition, social interactions, and emotions acquired from speech in...

(This article belongs to the Special Issue Multimodal User Interfaces and Experiences: Challenges, Applications, and Perspectives—2nd Edition)
  • Article
  • Open Access
18 Citations
4,796 Views
13 Pages

Hierarchical Transformer Network for Utterance-Level Emotion Recognition

  • Qingbiao Li,
  • Chunhua Wu,
  • Zhe Wang and
  • Kangfeng Zheng

28 June 2020

While there have been significant advances in detecting emotions in text, in the field of utterance-level emotion recognition (ULER), there are still many problems to be solved. In this paper, we address some challenges in ULER in dialog systems. (1)...

(This article belongs to the Section Computing and Artificial Intelligence)
  • Article
  • Open Access
4 Citations
5,863 Views
21 Pages

21 August 2025

Emotion-regulation ability and strategy (i.e., the specific behaviors used to manage feelings) are crucial for preschoolers’ socioemotional development. This study investigated whether a structured picture-book intervention could enhance these...

  • Article
  • Open Access
27 Citations
6,396 Views
15 Pages

Improving the Accuracy of Automatic Facial Expression Recognition in Speaking Subjects with Deep Learning

  • Sathya Bursic,
  • Giuseppe Boccignone,
  • Alfio Ferrara,
  • Alessandro D’Amelio and
  • Raffaella Lanzarotti

9 June 2020

When automatic facial expression recognition is applied to video sequences of speaking subjects, the recognition accuracy has been noted to be lower than with video sequences of still subjects. This effect known as the speaking effect arises during s...

(This article belongs to the Section Computing and Artificial Intelligence)

of 2