- Article
Randomized Modality Mixing with Patchwise RBF Networks for Robust Multimodal Pain Recognition
- Mehmet Erdal,
- Sascha Gruss and
- Friedhelm Schwenker
- + 1 author
Pain recognition based on multimodal physiological signals remains a challenge, not only because of the limited training data, but also due to the varying responses of individuals. In this article, we present a randomized modality mixing technique (Modmix) for multimodal data augmentation and a patchwise radial basis function (RBF) network designed to improve robustness in limited and highly heterogeneous data. Modmix generates new samples by randomly swapping modalities between existing data points, creating new data in a very simple but effective way. The RBF patch network divides the input into randomly selected, overlapping patches that capture local similarities between modalities. Each patch network is trained end-to-end using stochastic gradient descent. Moreover, the model’s performance is further improved by using multiple independently trained networks and combining them into a single decision. Experiments with the two different pain datasets X-ITE and BioVid were performed under limited training data conditions, where only approximately 30% of the original datasets were used for training. With both datasets the RBF patch network achieved significant improvements for a subset of subjects, resulting in a similar or even slightly better mean accuracy compared to competing related models such as random forest and support vector machine.
14 February 2026




![Architectural asymmetry in TCP/IP-based IoT stacks. (a) Each layer employs different naming schemes (URIs, ports, IP addresses, MAC addresses) and independent security mechanisms that do not compose coherently. Zigzag lines indicate semantic discontinuities at layer boundaries. (b) These asymmetries create security–functionality conflicts in IoT: DTLS encryption prevents CoAP proxies from performing caching and protocol translation; IPsec encryption hides transport headers from Performance Enhancing Proxies (PEPs) needed for wireless link optimization [4].](https://mdpi-res.com/cdn-cgi/image/w=281,h=192/https://mdpi-res.com/computers/computers-15-00125/article_deploy/html/images/computers-15-00125-ag-550.jpg)


